You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/02/22 01:38:22 UTC

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1622 - Still Failing!

Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1622/

All tests passed

Build Log:
[...truncated 67165 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1682 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1682/

All tests passed

Build Log:
[...truncated 67152 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1681 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1681/

1 tests failed.
FAILED:  org.apache.solr.util.TestCircuitBreaker.testResponseWithCBTiming

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([5E2ACB9BBDAD6A1A:B6F666794E45703A]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
	at org.apache.solr.util.TestCircuitBreaker.testResponseWithCBTiming(TestCircuitBreaker.java:245)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: Circuit Breakers tripped Memory Circuit Breaker triggered as JVM heap usage values are greater than allocated threshold.Seen JVM heap memory usage 474317328 and allocated threshold 398721024

	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:320)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:346)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:328)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:997)
	... 45 more




Build Log:
[...truncated 14527 lines...]
   [junit4] Suite: org.apache.solr.util.TestCircuitBreaker
   [junit4]   2> 1000458 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1000458 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1000458 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.util.TestCircuitBreaker_5E2ACB9BBDAD6A1A-001/data-dir-152-001
   [junit4]   2> 1000458 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=30 numCloses=30
   [junit4]   2> 1000458 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1000460 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1000460 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1000463 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1000474 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1000483 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 1000489 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1000961 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1000962 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@c9c2dbb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1000962 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@c9c2dbb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1000965 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@ebc4fa4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1000965 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@ebc4fa4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1000967 WARN  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1000991 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@50a46d0f
   [junit4]   2> 1000998 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@50a46d0f
   [junit4]   2> 1000998 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@50a46d0f
   [junit4]   2> 1000999 INFO  (coreLoadExecutor-7461-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1001005 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1001023 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1001041 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 1001049 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1001055 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 1001055 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@50a46d0f
   [junit4]   2> 1001055 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.util.TestCircuitBreaker_5E2ACB9BBDAD6A1A-001/data-dir-152-001/]
   [junit4]   2> 1001056 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1001092 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1001092 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1001093 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=88.84375, floorSegmentMB=1.6123046875, forceMergeDeletesPctAllowed=9.203538000780085, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=20.600239923617163
   [junit4]   2> 1001093 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 1001094 INFO  (coreLoadExecutor-7461-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1001095 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1001095 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001095 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001097 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001097 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001098 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001098 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001098 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001109 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001109 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 10
   [junit4]   2> 1001110 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001110 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001110 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001110 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001111 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001111 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001119 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001119 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 7
   [junit4]   2> 1001123 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 3
   [junit4]   2> 1001123 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001124 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001124 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001126 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001127 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001136 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001136 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 9
   [junit4]   2> 1001137 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001137 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001137 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001137 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001138 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001138 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001238 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001238 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 99
   [junit4]   2> 1001239 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001239 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001239 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001240 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001240 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001240 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001252 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001252 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 11
   [junit4]   2> 1001252 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001253 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001253 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001254 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001254 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001254 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001260 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001260 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 6
   [junit4]   2> 1001261 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001261 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001262 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001262 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001262 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001262 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001269 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001269 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 6
   [junit4]   2> 1001270 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001270 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001270 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001271 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001271 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001271 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001277 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001277 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001277 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001278 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001278 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001278 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001279 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001279 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001295 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001295 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 15
   [junit4]   2> 1001296 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001296 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001297 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001297 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001297 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001298 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001305 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001305 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 7
   [junit4]   2> 1001306 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001306 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001306 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001307 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001307 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001307 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001313 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001313 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001314 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001315 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001315 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001315 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001316 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001316 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001322 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001322 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001322 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001323 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001323 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001323 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001324 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001324 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001333 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001333 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 9
   [junit4]   2> 1001334 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001334 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001334 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001335 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001335 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001335 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001341 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001341 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001342 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001342 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001342 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001342 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001343 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001343 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001358 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001358 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
   [junit4]   2> 1001359 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001359 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001359 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001360 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001360 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001360 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001370 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001375 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
   [junit4]   2> 1001375 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001376 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001376 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001376 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001377 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001377 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001383 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001383 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001384 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001384 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001384 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001384 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001385 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001385 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001392 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001395 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 9
   [junit4]   2> 1001395 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001396 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001396 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001396 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001397 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001397 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001403 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001403 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 1001403 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001404 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001404 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001404 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 1001405 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 1001405 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 1001418 INFO  (searcherExecutor-7463-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1001418 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 12
   [junit4]   2> 1001422 INFO  (TEST-TestCircuitBreaker.testResponseWithCBTiming-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testResponseWithCBTiming
   [junit4]   2> 1001423 INFO  (TEST-TestCircuitBreaker.testResponseWithCBTiming-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml&debugQuery=true} status=503 QTime=0
   [junit4]   2> 1001423 ERROR (TEST-TestCircuitBreaker.testResponseWithCBTiming-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=*:*&wt=xml&debugQuery=true:org.apache.solr.common.SolrException: Circuit Breakers tripped Memory Circuit Breaker triggered as JVM heap usage values are greater than allocated threshold.Seen JVM heap memory usage 474317328 and allocated threshold 398721024
   [junit4]   2> 
   [junit4]   2> 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:320)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.query(TestHarness.java:346)
   [junit4]   2> 	at org.apache.solr.util.TestHarness.query(TestHarness.java:328)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:997)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]   2> 	at org.apache.solr.util.TestCircuitBreaker.testResponseWithCBTiming(TestCircuitBreaker.java:245)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1001424 INFO  (TEST-TestCircuitBreaker.testResponseWithCBTiming-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testResponseWithCBTiming
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCircuitBreaker -Dtests.method=testResponseWithCBTiming -Dtests.seed=5E2ACB9BBDAD6A1A -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-GT -Dtests.timezone=Asia/Oral -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.01s J3 | TestCircuitBreaker.testResponseWithCBTiming <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5E2ACB9BBDAD6A1A:B6F666794E45703A]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]    > 	at org.apache.solr.util.TestCircuitBreaker.testResponseWithCBTiming(TestCircuitBreaker.java:245)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: org.apache.solr.common.SolrException: Circuit Breakers tripped Memory Circuit Breaker triggered as JVM heap usage values are greater than allocated threshold.Seen JVM heap memory usage 474317328 and allocated threshold 398721024
   [junit4]    > 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:320)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
   [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:346)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:328)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:997)
   [junit4]    > 	... 45 more
   [junit4]   2> 1001435 INFO  (TEST-TestCircuitBreaker.testCBFakeMemoryPressure-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testCBFakeMemoryPressure
   [junit4]   2> 1001436 INFO  (TEST-TestCircuitBreaker.testCBFakeMemoryPressure-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001437 INFO  (TEST-TestCircuitBreaker.testCBFakeMemoryPressure-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testCBFakeMemoryPressure
   [junit4]   2> 1001441 INFO  (TEST-TestCircuitBreaker.testBuildingMemoryPressure-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBuildingMemoryPressure
   [junit4]   2> 1001456 INFO  (TestCircuitBreaker-7467-thread-1) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1001460 INFO  (TestCircuitBreaker-7467-thread-3) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1001460 INFO  (TestCircuitBreaker-7467-thread-4) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001460 INFO  (TestCircuitBreaker-7467-thread-1) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1001461 INFO  (TestCircuitBreaker-7467-thread-2) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1001461 INFO  (TEST-TestCircuitBreaker.testBuildingMemoryPressure-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBuildingMemoryPressure
   [junit4]   2> 1001465 INFO  (TEST-TestCircuitBreaker.testCBAlwaysTrips-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testCBAlwaysTrips
   [junit4]   2> 1001465 INFO  (TEST-TestCircuitBreaker.testCBAlwaysTrips-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001466 INFO  (TEST-TestCircuitBreaker.testCBAlwaysTrips-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testCBAlwaysTrips
   [junit4]   2> 1001469 INFO  (TEST-TestCircuitBreaker.testFakeCPUCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testFakeCPUCircuitBreaker
   [junit4]   2> 1001470 INFO  (TestCircuitBreaker-7468-thread-1) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001471 INFO  (TestCircuitBreaker-7468-thread-1) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001471 INFO  (TestCircuitBreaker-7468-thread-4) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001471 INFO  (TestCircuitBreaker-7468-thread-3) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=0
   [junit4]   2> 1001474 INFO  (TestCircuitBreaker-7468-thread-2) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=name:"john+smith"&qt=&start=0&rows=20&version=2.2} status=503 QTime=3
   [junit4]   2> 1001475 INFO  (TEST-TestCircuitBreaker.testFakeCPUCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testFakeCPUCircuitBreaker
   [junit4]   2> 1001475 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 1001475 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1411360284
   [junit4]   2> 1001475 INFO  (coreCloseExecutor-7470-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@19555c03
   [junit4]   2> 1001475 INFO  (coreCloseExecutor-7470-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@19555c03
   [junit4]   2> 1001475 INFO  (coreCloseExecutor-7470-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5579f552: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@164cf04f
   [junit4]   2> 1001486 INFO  (coreCloseExecutor-7470-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1001487 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1001487 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6af0fa34: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@5653926b
   [junit4]   2> 1001492 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1001492 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7e77bc79: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2f99258c
   [junit4]   2> 1001494 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1001494 INFO  (SUITE-TestCircuitBreaker-seed#[5E2ACB9BBDAD6A1A]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7bf5844a: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@537931b3
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.util.TestCircuitBreaker_5E2ACB9BBDAD6A1A-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {range_facet_l_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), _root_=Lucene84, intDefault=Lucene84, title=Lucene84, title_lettertok=PostingsFormat(name=LuceneVarGapDocFreqInterval), range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval), title_stringNoNorms=PostingsFormat(name=LuceneVarGapFixedInterval), title_stemmed=Lucene84, inStock_b1=PostingsFormat(name=MockRandom), name=PostingsFormat(name=LuceneVarGapDocFreqInterval), id_i1=Lucene84, id=PostingsFormat(name=LuceneVarGapDocFreqInterval), range_facet_i_dv=PostingsFormat(name=LuceneVarGapFixedInterval), text=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene80), range_facet_i_dv=DocValuesFormat(name=Lucene80), intDvoDefault=DocValuesFormat(name=Lucene80), timestamp=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=806, maxMBSortInHeap=5.216068363873099, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=es-GT, timezone=Asia/Oral
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=198060632,total=532152320
   [junit4]   2> NOTE: All tests run in this JVM: [TestPushWriter, TestSolrQueryResponse, TestReloadDeadlock, ParsingFieldUpdateProcessorsTest, TestStressIncrementalBackup, TestDeleteCollectionOnDownNodes, TestExpandComponent, ZkControllerTest, TestSlowCompositeReaderWrapper, TestNumericTerms32, RollingRestartTest, TestLRUStatsCache, SynonymTokenizerTest, TestCorePropertiesReload, ConnectionManagerTest, CSVRequestHandlerTest, TestTrie, BJQParserTest, TestManagedStopFilterFactory, SolrMetricReporterTest, DistributedSpellCheckComponentTest, ConfigureRecoveryStrategyTest, TestAuthenticationFramework, DistributedDebugComponentTest, TestDynamicURP, MBeansHandlerTest, SolrJmxReporterTest, UpdateLogTest, TestSolrDeletionPolicy2, TestRandomFaceting, DimensionalRoutedAliasUpdateProcessorTest, TimeZoneUtilsTest, MultiSolrCloudTestCaseTest, SolrTestCaseJ4DeleteCoreTest, TestSimLargeCluster, HdfsCollectionsAPIDistributedZkTest, TokenizerChainTest, ScheduledTriggerTest, TestSSLRandomization, TestDocTermOrdsUninvertLimit, JWTIssuerConfigTest, CloudExitableDirectoryReaderTest, TestDistributedGrouping, MinimalSchemaTest, TestMinMaxOnMultiValuedField, CollectionReloadTest, TestSort, ResponseBuilderTest, TestSortableTextField, TestDeprecatedFilters, TestSubQueryTransformer, TestSQLHandlerNonCloud, OutOfBoxZkACLAndCredentialsProvidersTest, AddReplicaTest, LegacyCloudClusterPropTest, MergeStrategyTest, TriLevelCompositeIdRoutingTest, DistributedFacetPivotLongTailTest, BlobRepositoryCloudTest, TestZkAclsWithHadoopAuth, TestFiltering, TestLMDirichletSimilarityFactory, TestGroupingSearch, ExecutePlanActionTest, OverseerTaskQueueTest, SmileWriterTest, TestStressReorder, HttpPartitionWithTlogReplicasTest, BadIndexSchemaTest, TestConfigSetsAPIExclusivity, TestSchemaSimilarityResource, TestRandomFlRTGCloud, TestJsonFacetRefinement, TestNumericRangeQuery64, TestPolicyCloud, TestInPlaceUpdateWithRouteField, ScriptEngineTest, DocValuesMultiTest, DocumentBuilderTest, AtomicUpdateProcessorFactoryTest, SortSpecParsingTest, DeleteStatusTest, AutoAddReplicasIntegrationTest, MetricsConfigTest, TestSolrJacksonAnnotation, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SecurityConfHandlerTest, BaseCdcrDistributedZkTest, SchemaApiFailureTest, CloudMLTQParserTest, TestNRTOpen, TestSkipOverseerOperations, AnalysisErrorHandlingTest, SolrCoreCheckLockOnStartupTest, TriggerSetPropertiesIntegrationTest, CoreAdminRequestStatusTest, SolrIndexSplitterTest, CloudReplicaSourceTest, TestLeaderElectionZkExpiry, TestHdfsBackupRestoreCore, RuleEngineTest, TestPointFields, RAMDirectoryFactoryTest, TestConfigSetProperties, SpellCheckComponentTest, SharedFSAutoReplicaFailoverTest, SolrXmlInZkTest, TestWaitForStateWithJettyShutdowns, TestLegacyNumericRangeQueryBuilder, TestScoreJoinQPNoScore, TestCodecSupport, TestCircuitBreaker]
   [junit4] Completed [378/934 (1!)] on J3 in 1.28s, 5 tests, 1 error <<< FAILURES!

[...truncated 52630 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1680 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1680/

All tests passed

Build Log:
[...truncated 67155 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1679 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1679/

All tests passed

Build Log:
[...truncated 67152 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1678 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1678/

All tests passed

Build Log:
[...truncated 67157 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1677 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1677/

All tests passed

Build Log:
[...truncated 67151 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1676 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1676/

2 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at https://127.0.0.1:38143/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:38143/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestHdfsBackupRestoreCore.test

Error Message:
Backup failure: rz expected null, but was:<codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.handler.TestHdfsBackupRestoreCore_6CD77207FAB2C7E-001/tempDir-002/node1/HdfsBackupRestore_shard1_replica_n1/data/index/_0.dii")))>

Stack Trace:
java.lang.AssertionError: Backup failure: rz expected null, but was:<codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.handler.TestHdfsBackupRestoreCore_6CD77207FAB2C7E-001/tempDir-002/node1/HdfsBackupRestore_shard1_replica_n1/data/index/_0.dii")))>
	at __randomizedtesting.SeedInfo.seed([6CD77207FAB2C7E:8E9948FAD1574186]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.failNotNull(Assert.java:756)
	at org.junit.Assert.assertNull(Assert.java:738)
	at org.apache.solr.handler.BackupStatusChecker._checkBackupSuccess(BackupStatusChecker.java:208)
	at org.apache.solr.handler.BackupStatusChecker.checkBackupSuccess(BackupStatusChecker.java:187)
	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:96)
	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:72)
	at org.apache.solr.handler.TestHdfsBackupRestoreCore.test(TestHdfsBackupRestoreCore.java:196)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13762 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 341859 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 341859 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 341859 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/data-dir-20-001
   [junit4]   2> 341859 WARN  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
   [junit4]   2> 341859 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 341861 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 341862 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001
   [junit4]   2> 341862 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 341862 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 341862 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 341863 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 341962 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 41325
   [junit4]   2> 341962 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:41325
   [junit4]   2> 341962 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41325
   [junit4]   2> 341962 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 41325
   [junit4]   2> 341992 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342005 INFO  (zkConnectionManagerCallback-4916-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342005 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342007 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342008 INFO  (zkConnectionManagerCallback-4918-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342008 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342012 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342016 INFO  (zkConnectionManagerCallback-4920-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342016 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342018 WARN  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker-SendThread(127.0.0.1:41325)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103af96b8c00002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 342125 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 342126 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 342126 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 342126 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 342126 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@373c3832{/solr,null,AVAILABLE}
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5a4bb25f{SSL, (ssl, http/1.1)}{127.0.0.1:38143}
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.e.j.s.Server Started @342159ms
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:41325/solr, hostPort=38143}
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 342129 ERROR (jetty-launcher-4921-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T15:19:03.305Z
   [junit4]   2> 342129 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d4d311c{/solr,null,AVAILABLE}
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@691ad06c{SSL, (ssl, http/1.1)}{127.0.0.1:38285}
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.e.j.s.Server Started @342163ms
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:41325/solr, hostPort=38285}
   [junit4]   2> 342133 ERROR (jetty-launcher-4921-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 342133 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T15:19:03.309Z
   [junit4]   2> 342134 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342134 INFO  (zkConnectionManagerCallback-4923-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342134 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342135 INFO  (zkConnectionManagerCallback-4925-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342135 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 342135 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342135 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 342138 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 342141 WARN  (jetty-launcher-4921-thread-2-SendThread(127.0.0.1:41325)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103af96b8c00004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 342141 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 342142 WARN  (jetty-launcher-4921-thread-1-SendThread(127.0.0.1:41325)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103af96b8c00003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c00003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 342749 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 342750 WARN  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 342750 WARN  (jetty-launcher-4921-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@54015250[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342750 WARN  (jetty-launcher-4921-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@54015250[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342753 WARN  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 342753 WARN  (jetty-launcher-4921-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3ce8f6c8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342753 WARN  (jetty-launcher-4921-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3ce8f6c8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342754 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41325/solr
   [junit4]   2> 342755 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342756 INFO  (zkConnectionManagerCallback-4939-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342756 INFO  (jetty-launcher-4921-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342857 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342858 INFO  (zkConnectionManagerCallback-4941-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342858 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342911 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38143_solr
   [junit4]   2> 342912 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.Overseer Overseer (id=73095080847605766-127.0.0.1:38143_solr-n_0000000000) starting
   [junit4]   2> 342912 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 342913 WARN  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 342914 WARN  (jetty-launcher-4921-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2dd2e8ce[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342914 WARN  (jetty-launcher-4921-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2dd2e8ce[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342915 WARN  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 342916 WARN  (jetty-launcher-4921-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3d2ce5cd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342916 WARN  (jetty-launcher-4921-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3d2ce5cd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 342917 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41325/solr
   [junit4]   2> 342918 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 342918 INFO  (zkConnectionManagerCallback-4951-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 342918 INFO  (jetty-launcher-4921-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 342920 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38143_solr
   [junit4]   2> 342920 INFO  (OverseerStateUpdate-73095080847605766-127.0.0.1:38143_solr-n_0000000000) [n:127.0.0.1:38143_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:38143_solr
   [junit4]   2> 342921 INFO  (OverseerStateUpdate-73095080847605766-127.0.0.1:38143_solr-n_0000000000) [n:127.0.0.1:38143_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 342922 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 342922 WARN  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 342936 INFO  (jetty-launcher-4921-thread-1) [n:127.0.0.1:38143_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node1
   [junit4]   2> 343020 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 343021 INFO  (zkConnectionManagerCallback-4961-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 343021 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 343025 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 343028 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:38285_solr as DOWN
   [junit4]   2> 343029 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 343029 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38285_solr
   [junit4]   2> 343030 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 343030 INFO  (zkCallback-4960-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 343031 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 343031 WARN  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 343041 INFO  (jetty-launcher-4921-thread-2) [n:127.0.0.1:38285_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node2
   [junit4]   2> 343047 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 343047 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 343048 INFO  (zkConnectionManagerCallback-4972-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 343048 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 343049 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 343050 INFO  (SUITE-LeaderTragicEventTest-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41325/solr ready
   [junit4]   2> 343065 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 343095 INFO  (OverseerThreadFactory-4956-thread-1-processing-n:127.0.0.1:38143_solr) [n:127.0.0.1:38143_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 343206 INFO  (OverseerStateUpdate-73095080847605766-127.0.0.1:38143_solr-n_0000000000) [n:127.0.0.1:38143_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:38143_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:38143/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 343208 INFO  (OverseerStateUpdate-73095080847605766-127.0.0.1:38143_solr-n_0000000000) [n:127.0.0.1:38143_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:38285_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:38285/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 343427 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 343428 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 343439 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 343446 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 343446 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 343446 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 343446 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 343447 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 343459 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 343465 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 343466 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 343466 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 343466 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 343483 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 343483 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 343484 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 343484 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 343486 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 343486 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 343486 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 343486 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693224528418701312
   [junit4]   2> 343492 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 343492 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 343493 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 343493 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 343495 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 343495 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 343495 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 343496 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693224528429187072
   [junit4]   2> 343498 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 343498 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 343504 INFO  (searcherExecutor-4976-thread-1-processing-n:127.0.0.1:38285_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 343504 INFO  (searcherExecutor-4974-thread-1-processing-n:127.0.0.1:38143_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 343508 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoute in=9998ms
   [junit4]   2> 343509 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 343509 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 344009 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 344009 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 344009 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38143/solr/testOtherReplicasAreNotActive_shard1_replica_n1/
   [junit4]   2> 344010 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n1 url=https://127.0.0.1:38143/solr  START replicas=[https://127.0.0.1:38285/solr/testOtherReplicasAreNotActive_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 344010 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n1 url=https://127.0.0.1:38143/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 344018 INFO  (qtp1675803420-8431) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 344018 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 344018 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 344018 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73095080847605766-core_node3-n_0000000000
   [junit4]   2> 344021 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38143/solr/testOtherReplicasAreNotActive_shard1_replica_n1/ shard1
   [junit4]   2> 344123 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344123 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 344127 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=699
   [junit4]   2> 344226 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344226 INFO  (zkCallback-4940-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344517 INFO  (qtp1675803420-8433) [n:127.0.0.1:38285_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1071
   [junit4]   2> 344520 INFO  (qtp1353963823-8425) [n:127.0.0.1:38143_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 344617 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344617 INFO  (zkCallback-4960-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344617 INFO  (zkCallback-4940-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344617 INFO  (zkCallback-4960-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 344618 INFO  (qtp1353963823-8425) [n:127.0.0.1:38143_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1524
   [junit4]   2> 344618 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 344623 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : https://127.0.0.1:38285/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/5 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:38143_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:38143/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:38285_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:38285/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 344623 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=230305452
   [junit4]   2> 344623 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38285_solr
   [junit4]   2> 344623 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 344623 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:38285_solr as DOWN
   [junit4]   2> 344626 INFO  (coreCloseExecutor-4988-thread-1) [n:127.0.0.1:38285_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@48952efe
   [junit4]   2> 344626 INFO  (coreCloseExecutor-4988-thread-1) [n:127.0.0.1:38285_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n2 tag=SolrCore@48952efe
   [junit4]   2> 344626 INFO  (coreCloseExecutor-4988-thread-1) [n:127.0.0.1:38285_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@48952efe
   [junit4]   2> 344627 INFO  (coreCloseExecutor-4988-thread-1) [n:127.0.0.1:38285_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 344630 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 344630 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 344630 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 344630 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 344634 INFO  (zkCallback-4971-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 344634 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 344726 INFO  (zkCallback-4940-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 344726 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 344742 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@691ad06c{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 344742 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7d4d311c{/solr,null,STOPPED}
   [junit4]   2> 344742 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 344743 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 38285
   [junit4]   2> 344743 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 344752 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node3:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:38143_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:38143/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 344761 ERROR (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2215) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 40 more
   [junit4]   2> 344764 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 344764 ERROR (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 344764 INFO  (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=4
   [junit4]   2> 344764 ERROR (qtp1353963823-8424) [n:127.0.0.1:38143_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 344769 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=38285)
   [junit4]   2> 344770 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 38285 try number 2 ...
   [junit4]   2> 344770 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 344771 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 344771 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 344771 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 344771 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c4842{/solr,null,AVAILABLE}
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@33bb1238{SSL, (ssl, http/1.1)}{127.0.0.1:38285}
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.s.Server Started @344803ms
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:41325/solr, hostPort=38285}
   [junit4]   2> 344772 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 344772 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T15:19:05.948Z
   [junit4]   2> 344773 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 344774 INFO  (zkConnectionManagerCallback-4992-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 344775 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 344775 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 344779 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 344779 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]-SendThread(127.0.0.1:41325)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103af96b8c0000a.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c0000a, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103af96b8c0000a, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 345097 INFO  (OverseerCollectionConfigSetProcessor-73095080847605766-127.0.0.1:38143_solr-n_0000000000) [n:127.0.0.1:38143_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 345423 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 345423 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 345428 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@707cbed0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 345428 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@707cbed0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 345432 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 345436 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@9d28bde[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 345436 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@9d28bde[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 345437 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41325/solr
   [junit4]   2> 345438 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 345439 INFO  (zkConnectionManagerCallback-5003-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 345439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 345541 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 345542 INFO  (zkConnectionManagerCallback-5005-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 345542 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 345548 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 345553 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:38285_solr as DOWN
   [junit4]   2> 345554 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 345554 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38285_solr
   [junit4]   2> 345555 INFO  (zkCallback-4940-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 345556 INFO  (zkCallback-4971-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 345556 INFO  (zkCallback-5004-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 345557 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 345558 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 345573 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_6CD77207FAB2C7E-001/tempDir-001/node2
   [junit4]   2> 345573 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[6CD77207FAB2C7E]) [n:127.0.0.1:38285_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [testOtherReplicasAreNotActive_shard1_replica_n2]
   [junit4]   2> 345589 INFO  (coreLoadExecutor-5011-thread-1-processing-n:127.0.0.1:38285_solr) [n:127.0.0.1:38285_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 345596 INFO  (coreLoadExecutor-5011-thread-1-processing-n:127.0.0.1:38285_solr) [n:127.0.0.1:38285_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 345597 INFO  (coreLoadExecutor-5011-thread-1-processing-n:127.0.0.1:38285_solr) [n:127.0.0.1:38285_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 345603 INFO  (coreLoadExecutor-5011-thread-1-processing-n:127.0.0.1:38285_solr) [n:127.0.0.1:38285_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 345609 INFO  (coreLoadExecutor-5011-th

[...truncated too long message...]

NFO  (jetty-closer-23188-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@16a28faf: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1f00efcd
   [junit4]   2> 2049369 INFO  (jetty-closer-23188-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 2049369 INFO  (jetty-closer-23188-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@39faedca: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@46b0eca3
   [junit4]   2> 2049369 INFO  (jetty-closer-23188-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 2049370 INFO  (closeThreadPool-23194-thread-2) [     ] o.a.s.c.Overseer Overseer (id=73095192573771781-127.0.0.1:46225_solr-n_0000000000) closing
   [junit4]   2> 2049372 INFO  (OverseerStateUpdate-73095192573771781-127.0.0.1:46225_solr-n_0000000000) [n:127.0.0.1:46225_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46225_solr
   [junit4]   2> 2049376 INFO  (OverseerAutoScalingTriggerThread-73095192573771781-127.0.0.1:46225_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2049381 INFO  (closeThreadPool-23194-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73095192573771781-127.0.0.1:46225_solr-n_0000000000) closing
   [junit4]   2> 2049482 INFO  (jetty-closer-23188-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73095192573771781-127.0.0.1:46225_solr-n_0000000000) closing
   [junit4]   2> 2049484 INFO  (jetty-closer-23188-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2f30214f{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 2049484 INFO  (jetty-closer-23188-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@375fb9da{/solr,null,STOPPED}
   [junit4]   2> 2049484 INFO  (jetty-closer-23188-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 2049490 INFO  (SUITE-TestHdfsBackupRestoreCore-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 2049693 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/collections/HdfsBackupRestore/terms/shard1
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/collections/HdfsBackupRestore/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/overseer/queue
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	4	/solr/collections/HdfsBackupRestore/state.json
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 2049695 INFO  (SUITE-TestHdfsBackupRestoreCore-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:32939
   [junit4]   2> 2049695 INFO  (SUITE-TestHdfsBackupRestoreCore-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:32939
   [junit4]   2> 2049695 INFO  (SUITE-TestHdfsBackupRestoreCore-seed#[6CD77207FAB2C7E]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 32939
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.handler.TestHdfsBackupRestoreCore_6CD77207FAB2C7E-001
   [junit4]   2> Mar 03, 2021 3:47:31 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 33 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=SimpleText, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ar-MA, timezone=Europe/Warsaw
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=6,free=201891512,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestPullReplicaErrorHandling, SecurityHeadersTest, TestFastOutputStream, TestStressLiveNodes, TestCloudDeleteByQuery, TestLogWatcher, PeerSyncWithLeaderTest, TestSimComputePlanAction, TestFieldCollectionResource, WrapperMergePolicyFactoryTest, TestConfigOverlay, ReplicationFactorTest, TestRebalanceLeaders, SuggesterFSTTest, TestSimNodeLostTrigger, TestAddFieldRealTimeGet, TestSolrJ, TestOverriddenPrefixQueryForCustomFieldType, LargeFieldTest, DaemonStreamApiTest, SolrIndexConfigTest, RankFieldTest, LeaderTragicEventTest, TestSystemCollAutoCreate, DirectoryFactoriesTest, DistributedFacetPivotSmallTest, TestChildDocTransformerHierarchy, TestStreamBody, TestCloudNestedDocsSort, TestReplicationHandler, DistributedIntervalFacetingTest, ByteBuffersDirectoryFactoryTest, DistribDocExpirationUpdateProcessorTest, TestDynamicLoading, BlockCacheTest, AnalyticsQueryTest, ReindexCollectionTest, TestUpdate, DataDrivenBlockJoinTest, TestSolrCloudWithKerberosAlt, TestConfigSetsAPIZkFailure, TestValueSourceCache, ShardRoutingTest, ZkStateWriterTest, TestCSVResponseWriter, TestInPlaceUpdatesRequiredField, TestSolr4Spatial2, TestShortCircuitedRequests, TestFreeTextSuggestions, RequestLoggingTest, HttpPartitionOnCommitTest, PolyFieldTest, EnumFieldTest, CollectionsAPISolrJTest, TestMacros, ZkNodePropsTest, VMParamsZkACLAndCredentialsProvidersTest, ShowFileRequestHandlerTest, TestPivotHelperCode, TestClusterProperties, URLClassifyProcessorTest, TermsComponentTest, TestAnalyzeInfixSuggestions, TestSchemaNameResource, TestBulkSchemaConcurrent, TestRestoreCore, JWTAuthPluginIntegrationTest, TestCoreContainer, FileBasedSpellCheckerTest, TestMiniSolrCloudClusterSSL, SolrCloudReportersTest, TestRangeQuery, TestInfoStreamLogging, CloneFieldUpdateProcessorFactoryTest, TestStressLucene, MetricsHistoryHandlerTest, TestComplexPhraseLeadingWildcard, TestBM25SimilarityFactory, TestCollectionAPI, ManagedSchemaRoundRobinCloudTest, CdcrBootstrapTest, TestFacetMethods, TestCoreAdminApis, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, DistributedFacetExistsSmallTest, MoveReplicaHDFSTest, TestExternalRoleRuleBasedAuthorizationPlugin, TestSubQueryTransformerDistrib, TestManagedSynonymGraphFilterFactory, TestImpersonationWithHadoopAuth, SearchRateTriggerTest, ScheduledMaintenanceTriggerTest, TestBulkSchemaAPI, TestBackupRepositoryFactory, ZookeeperStatusHandlerTest, TestFieldCacheReopen, TestSimUtils, HdfsRecoverLeaseTest, AssignBackwardCompatibilityTest, FieldAnalysisRequestHandlerTest, ResourceLoaderTest, CustomCollectionTest, TestSolrCoreProperties, TestJsonFacetsStatsParsing, OverseerCollectionConfigSetProcessorTest, SystemInfoHandlerTest, JavaBinAtomicUpdateMultivalueTest, HdfsLockFactoryTest, AuditLoggerPluginTest, TestSimExtremeIndexing, TestRecoveryHdfs, SyncSliceTest, TestFieldCacheWithThreads, SolrCloudExampleTest, TestDistribDocBasedVersion, TestSizeLimitedDistributedMap, TestTlogReplayVsRecovery, TestTlogReplica, HdfsCollectionsAPIDistributedZkTest, LocalFSCloudIncrementalBackupTest, SimpleCollectionCreateDeleteTest, AutoAddReplicasPlanActionTest, IndexSizeTriggerMixedBoundsTest, ScheduledTriggerIntegrationTest, TestSimDistributedQueue, BaseCdcrDistributedZkTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, QueryResultKeyTest, TestMergePolicyConfig, TestSolrCloudSnapshots, TestHdfsBackupRestoreCore]
   [junit4] Completed [646/934 (2!)] on J1 in 15.55s, 1 test, 1 failure <<< FAILURES!

[...truncated 51624 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1675 - Failure!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1675/

All tests passed

Build Log:
[...truncated 67178 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1674 - Still unstable!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1674/

1 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at https://127.0.0.1:38999/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:38999/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14953 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 1452831 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1452831 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1452831 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/data-dir-153-001
   [junit4]   2> 1452832 WARN  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
   [junit4]   2> 1452832 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1452833 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1452834 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001
   [junit4]   2> 1452834 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1452834 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1452834 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1452835 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1452934 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 45201
   [junit4]   2> 1452935 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:45201
   [junit4]   2> 1452935 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45201
   [junit4]   2> 1452935 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45201
   [junit4]   2> 1452936 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1452939 INFO  (zkConnectionManagerCallback-14659-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1452939 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1452942 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1452944 INFO  (zkConnectionManagerCallback-14661-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1452944 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1452945 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1452946 INFO  (zkConnectionManagerCallback-14663-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1452946 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1453051 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1453052 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ef4ebe2{/solr,null,AVAILABLE}
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5df857a6{/solr,null,AVAILABLE}
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@217949b3{SSL, (ssl, http/1.1)}{127.0.0.1:38999}
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@46bdef9f{SSL, (ssl, http/1.1)}{127.0.0.1:37915}
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-1) [     ] o.e.j.s.Server Started @1453090ms
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-2) [     ] o.e.j.s.Server Started @1453090ms
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45201/solr, hostPort=38999}
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45201/solr, hostPort=37915}
   [junit4]   2> 1453053 ERROR (jetty-launcher-14664-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1453053 ERROR (jetty-launcher-14664-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1453053 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T08:09:45.218Z
   [junit4]   2> 1453054 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T08:09:45.218Z
   [junit4]   2> 1453055 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453055 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453055 INFO  (zkConnectionManagerCallback-14668-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453055 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453055 INFO  (zkConnectionManagerCallback-14667-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453056 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453056 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1453056 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1453059 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1453059 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1453060 WARN  (jetty-launcher-14664-thread-2-SendThread(127.0.0.1:45201)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103ae0fe25e0003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1453431 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1453431 WARN  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1453432 WARN  (jetty-launcher-14664-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@456c02fc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453432 WARN  (jetty-launcher-14664-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@456c02fc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453437 WARN  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1453438 WARN  (jetty-launcher-14664-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@77881523[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453438 WARN  (jetty-launcher-14664-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@77881523[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453439 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45201/solr
   [junit4]   2> 1453440 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453442 INFO  (zkConnectionManagerCallback-14682-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453442 INFO  (jetty-launcher-14664-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453543 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453544 INFO  (zkConnectionManagerCallback-14684-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453544 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453609 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38999_solr
   [junit4]   2> 1453610 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.Overseer Overseer (id=73093402213613574-127.0.0.1:38999_solr-n_0000000000) starting
   [junit4]   2> 1453614 INFO  (OverseerStateUpdate-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:38999_solr
   [junit4]   2> 1453614 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38999_solr
   [junit4]   2> 1453615 INFO  (OverseerStateUpdate-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1453619 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1453620 WARN  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1453634 INFO  (jetty-launcher-14664-thread-1) [n:127.0.0.1:38999_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node1
   [junit4]   2> 1453873 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1453873 WARN  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1453874 WARN  (jetty-launcher-14664-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7e58c956[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453874 WARN  (jetty-launcher-14664-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7e58c956[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453876 WARN  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1453877 WARN  (jetty-launcher-14664-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@449e4306[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453877 WARN  (jetty-launcher-14664-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@449e4306[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1453878 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45201/solr
   [junit4]   2> 1453879 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453880 INFO  (zkConnectionManagerCallback-14702-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453880 INFO  (jetty-launcher-14664-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453981 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1453982 INFO  (zkConnectionManagerCallback-14704-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1453982 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1453986 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1453990 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:37915_solr as DOWN
   [junit4]   2> 1453991 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1453991 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37915_solr
   [junit4]   2> 1453992 INFO  (zkCallback-14683-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1453992 INFO  (zkCallback-14703-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1453993 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1453993 WARN  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1454009 INFO  (jetty-launcher-14664-thread-2) [n:127.0.0.1:37915_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2
   [junit4]   2> 1454015 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1454016 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1454017 INFO  (zkConnectionManagerCallback-14715-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1454017 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1454018 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1454019 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45201/solr ready
   [junit4]   2> 1454037 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 1454064 INFO  (OverseerThreadFactory-14691-thread-1-processing-n:127.0.0.1:38999_solr) [n:127.0.0.1:38999_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 1454170 INFO  (OverseerStateUpdate-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:37915_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:37915/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1454172 INFO  (OverseerStateUpdate-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:38999_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:38999/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1454384 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1454384 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1454395 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1454402 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1454402 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1454402 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1454402 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1454403 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 1454410 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1454417 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1454418 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1454418 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1454418 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1454436 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1454436 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1454437 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1454437 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1454438 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1454439 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1454439 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1454439 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693197519136227328
   [junit4]   2> 1454441 INFO  (searcherExecutor-14717-thread-1-processing-n:127.0.0.1:38999_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1454444 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1454444 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1454445 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1454445 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1454445 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1454446 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1454447 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1454447 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1454447 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1454447 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693197519144615936
   [junit4]   2> 1454449 INFO  (searcherExecutor-14719-thread-1-processing-n:127.0.0.1:37915_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1454451 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoute in=9999ms
   [junit4]   2> 1454453 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1454454 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1454953 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1454953 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1454953 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38999/solr/testOtherReplicasAreNotActive_shard1_replica_n2/
   [junit4]   2> 1454953 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:38999/solr  START replicas=[https://127.0.0.1:37915/solr/testOtherReplicasAreNotActive_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1454954 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:38999/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1454961 INFO  (qtp1279624431-24599) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1454961 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1454961 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1454961 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73093402213613574-core_node4-n_0000000000
   [junit4]   2> 1454963 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38999/solr/testOtherReplicasAreNotActive_shard1_replica_n2/ shard1
   [junit4]   2> 1455065 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455065 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1455069 INFO  (qtp729883331-24600) [n:127.0.0.1:38999_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=685
   [junit4]   2> 1455168 INFO  (zkCallback-14683-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455168 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455462 INFO  (qtp1279624431-24603) [n:127.0.0.1:37915_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1060
   [junit4]   2> 1455464 INFO  (qtp729883331-24604) [n:127.0.0.1:38999_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1455561 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455561 INFO  (zkCallback-14683-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455561 INFO  (zkCallback-14703-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455561 INFO  (zkCallback-14703-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1455562 INFO  (qtp729883331-24604) [n:127.0.0.1:38999_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1500
   [junit4]   2> 1455562 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 1455566 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : https://127.0.0.1:37915/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/5 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:37915_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:37915/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:38999_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:38999/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 1455566 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=371546717
   [junit4]   2> 1455566 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37915_solr
   [junit4]   2> 1455567 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1455567 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:37915_solr as DOWN
   [junit4]   2> 1455568 INFO  (coreCloseExecutor-14731-thread-1) [n:127.0.0.1:37915_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ded4f2f
   [junit4]   2> 1455568 INFO  (coreCloseExecutor-14731-thread-1) [n:127.0.0.1:37915_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n1 tag=SolrCore@6ded4f2f
   [junit4]   2> 1455568 INFO  (coreCloseExecutor-14731-thread-1) [n:127.0.0.1:37915_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@6ded4f2f
   [junit4]   2> 1455570 INFO  (coreCloseExecutor-14731-thread-1) [n:127.0.0.1:37915_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1455570 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1455570 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1455570 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1455570 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1455575 INFO  (zkCallback-14683-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1455575 WARN  (jetty-launcher-14664-thread-2-SendThread(127.0.0.1:45201)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103ae0fe25e0008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1455575 INFO  (zkCallback-14714-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1455669 INFO  (zkCallback-14683-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1455669 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1455677 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@46bdef9f{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1455677 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ef4ebe2{/solr,null,STOPPED}
   [junit4]   2> 1455677 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1455677 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 37915
   [junit4]   2> 1455678 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 1455681 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node4:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:38999_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:38999/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 1455689 ERROR (qtp729883331-24598) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2215) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 40 more
   [junit4]   2> 1455691 INFO  (qtp729883331-24598) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1455691 ERROR (qtp729883331-24598) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1455691 INFO  (qtp729883331-24598) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=3
   [junit4]   2> 1455691 ERROR (qtp729883331-24598) [n:127.0.0.1:38999_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1455695 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=37915)
   [junit4]   2> 1455696 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 37915 try number 2 ...
   [junit4]   2> 1455696 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1455696 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1455696 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1455696 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1455697 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b44ae0a{/solr,null,AVAILABLE}
   [junit4]   2> 1455711 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5dc60d96{SSL, (ssl, http/1.1)}{127.0.0.1:37915}
   [junit4]   2> 1455711 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.s.Server Started @1455748ms
   [junit4]   2> 1455711 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45201/solr, hostPort=37915}
   [junit4]   2> 1455712 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-03T08:09:47.876Z
   [junit4]   2> 1455712 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455713 INFO  (zkConnectionManagerCallback-14735-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455713 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455714 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1455717 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1456066 INFO  (OverseerCollectionConfigSetProcessor-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1456137 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1456137 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1456138 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3bc2605d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1456138 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3bc2605d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1456140 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1456141 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2872657d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1456141 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2872657d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1456142 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45201/solr
   [junit4]   2> 1456143 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1456144 INFO  (zkConnectionManagerCallback-14746-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1456144 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1456245 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1456246 INFO  (zkConnectionManagerCallback-14748-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1456246 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1456250 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1456254 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:37915_solr as DOWN
   [junit4]   2> 1456255 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1456255 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37915_solr
   [junit4]   2> 1456256 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1456256 INFO  (zkCallback-14714-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1456256 INFO  (zkCallback-14747-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1456262 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1456262 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1456278 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2
   [junit4]   2> 1456278 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [n:127.0.0.1:37915_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [testOtherReplicasAreNotActive_shard1_replica_n1]
   [junit4]   2> 1456285 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1456292 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1456292 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1456298 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1456304 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1456305 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1456305 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1456305 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1456332 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1456332 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1456332 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1456332 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1456333 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1456334 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1456334 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1456334 INFO  (coreLoadExecutor-14754-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693197521123278848
   [junit4]   2> 1456336 INFO  (searcherExecutor-14756-thread-1-processing-n:127.0.0.1:37915_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1456336 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:37915_solr
   [junit4]   2> 1456337 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[9D03B99D907231D]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testOtherReplicasAreNotActive
   [junit4]   2> 1456340 INFO  (coreZkRegister-14736-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1456344 INFO  (coreZkRegister-14736-thread-1-processing-n:127.0.0.1:37915_solr) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkController Core needs to recover:testOtherReplicasAreNotActive_shard1_replica_n1
   [junit4]   2> 1456344 INFO  (updateExecutor-14742-thread-1-processing-n:127.0.0.1:37915_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1456345 INFO  (recoveryExecutor-14744-thread-1-processing-n:127.0.0.1:37915_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 1456345 INFO  (recoveryExecutor-14744-thread-1-processing-n:127.0.0.1:37915_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:37915_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.RecoveryStrategy startupVersions is empty
   [junit4]   2> 1456356 INFO  (zkCallback-14683-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1456356 INFO  (zkCallback-14683-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDat

[...truncated too long message...]

213613574-127.0.0.1:38999_solr-n_0000000000) closing
   [junit4]   2> 1467282 INFO  (OverseerStateUpdate-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [n:127.0.0.1:38999_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38999_solr
   [junit4]   2> 1467282 INFO  (jetty-closer-14767-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1467282 INFO  (jetty-closer-14767-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1467282 INFO  (jetty-closer-14767-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1467282 INFO  (jetty-closer-14767-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1467286 INFO  (OverseerAutoScalingTriggerThread-73093402213613574-127.0.0.1:38999_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1467291 INFO  (zkCallback-14747-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1467298 INFO  (closeThreadPool-14776-thread-2) [     ] o.a.s.c.Overseer Overseer (id=73093402213613574-127.0.0.1:38999_solr-n_0000000000) closing
   [junit4]   2> 1467391 INFO  (jetty-closer-14767-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73093402213613574-127.0.0.1:38999_solr-n_0000000000) closing
   [junit4]   2> 1467391 INFO  (jetty-closer-14767-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@217949b3{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1467392 INFO  (jetty-closer-14767-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5df857a6{/solr,null,STOPPED}
   [junit4]   2> 1467392 INFO  (jetty-closer-14767-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1467492 INFO  (jetty-closer-14767-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5dc60d96{SSL, (ssl, http/1.1)}{127.0.0.1:37915}
   [junit4]   2> 1467492 INFO  (jetty-closer-14767-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4b44ae0a{/solr,null,STOPPED}
   [junit4]   2> 1467492 INFO  (jetty-closer-14767-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1467493 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1467494 WARN  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker-SendThread(127.0.0.1:45201)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103ae0fe25e0000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103ae0fe25e0000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1467696 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/testOtherReplicasAreNotActive/terms/shard1
   [junit4]   2> 	8	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/configs/config
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	2	/solr/collections/testLeaderFailsOver/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	29	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73093402213613574-core_node4-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/73093402213613574-127.0.0.1:38999_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/overseer/queue
   [junit4]   2> 	16	/solr/collections
   [junit4]   2> 	16	/solr/overseer/collection-queue-work
   [junit4]   2> 	14	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 
   [junit4]   2> 1467698 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:45201
   [junit4]   2> 1467698 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45201
   [junit4]   2> 1467698 INFO  (SUITE-LeaderTragicEventTest-seed#[9D03B99D907231D]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45201
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderTragicEventTest_9D03B99D907231D-001
   [junit4]   2> Mar 03, 2021 8:09:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=250, maxMBSortInHeap=7.18465375301289, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=nl-NL, timezone=Canada/Atlantic
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=185356024,total=521142272
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedFacetPivotLargeTest, TestQueryingOnDownCollection, QueryElevationComponentTest, TestHashQParserPlugin, TestSolrCloudWithSecureImpersonation, TestDynamicLoadingUrl, NodeLostTriggerTest, HighlighterTest, SearchHandlerTest, TestSimpleQParserPlugin, TestRandomDVFaceting, TestAnalyzedSuggestions, OrderedExecutorTest, TestMinimalConfig, ImplicitSnitchTest, UUIDUpdateProcessorFallbackTest, AddSchemaFieldsUpdateProcessorFactoryTest, AddBlockUpdateTest, BasicDistributedZk2Test, CleanupOldIndexTest, TestCursorMarkWithoutUniqueKey, TestExactStatsCache, TestUnInvertedFieldException, TestJsonRequest, TestSolrDeletionPolicy1, TestApiFramework, TestSnapshotCloudManager, TestSchemaResource, SystemLogListenerTest, SolrRequestParserTest, CoreAdminOperationTest, ZkCLITest, JvmMetricsTest, PeerSyncReplicationTest, RemoteQueryErrorTest, NotRequiredUniqueKeyTest, TestFuzzyAnalyzedSuggestions, TestDownShardTolerantSearch, PKIAuthenticationIntegrationTest, TestLeaderElectionWithEmptyReplica, BadComponentTest, TlogReplayBufferedWhileIndexingTest, TestJsonFacetsWithNestedObjects, RestartWhileUpdatingTest, TestRequestForwarding, TestNonDefinedSimilarityFactory, TestSurroundQueryParser, ExternalFileFieldSortTest, DocValuesMissingTest, TestPHPSerializedResponseWriter, TestDistributedStatsComponentCardinality, RankQParserPluginTest, TestOnReconnectListenerSupport, SolrJmxReporterCloudTest, MigrateRouteKeyTest, LeaderVoteWaitTimeoutTest, TestCryptoKeys, TestSolrCLIRunExample, TestConfigSetsAPI, PropertiesRequestHandlerTest, TestContainerPlugin, TestSQLHandler, TestReRankQParserPlugin, ClassificationUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, TestQueryUtils, ThreadDumpHandlerTest, TestFunctionQuery, QueryResultKeyTest, TestIBSimilarityFactory, RandomizedTaggerTest, CdcrWithNodesRestartsTest, HealthCheckHandlerTest, MoveReplicaTest, TestComplexPhraseQParserPlugin, TestFilteredDocIdSet, TestEmbeddedSolrServerConstructors, PreAnalyzedFieldManagedSchemaCloudTest, HdfsTlogReplayBufferedWhileIndexingTest, SpatialRPTFieldTypeTest, HdfsCloudIncrementalBackupTest, TestClusterStateMutator, TestFieldCacheSort, CollectionsAPIDistributedZkTest, TestDocumentBuilder, TestUseDocValuesAsStored2, TestCopyFieldCollectionResource, CachingDirectoryFactoryTest, TestBlockCollapse, PeerSyncWithBufferUpdatesTest, TestCollectionsAPIViaSolrCloudCluster, TestTlogReplayVsRecovery, TestLRUCache, TransactionLogTest, TestSimGenericDistributedQueue, TestMaxTokenLenTokenizer, DirectoryFactoryTest, DistanceUnitsTest, AuthToolTest, TestPartialUpdateDeduplication, BinaryUpdateRequestHandlerTest, TestTrackingShardHandlerFactory, BlockJoinFacetSimpleTest, HdfsRecoveryZkTest, OverseerStatusTest, EchoParamsTest, TestRetrieveFieldsOptimizer, SSLMigrationTest, BackupRestoreApiErrorConditionsTest, SparseHLLTest, TestDocTermOrds, TestLegacyFieldReuse, TestReloadAndDeleteDocs, DistanceFunctionTest, ConvertedLegacyTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ChaosMonkeySafeLeaderWithPullReplicasTest, ConcurrentCreateRoutedAliasTest, ConnectionManagerTest, CreateRoutedAliasTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteShardTest, DeleteStatusTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, LeaderElectionTest, LeaderFailoverAfterPartitionTest, LeaderTragicEventTest]
   [junit4] Completed [523/934 (1!)] on J2 in 15.76s, 2 tests, 1 error <<< FAILURES!

[...truncated 52259 lines...]

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1673 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1673/

1 tests failed.
FAILED:  org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([623DF12871F4FCD4:E4FD161DD5129FBD]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">215</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
</response>

	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
	... 45 more




Build Log:
[...truncated 15920 lines...]
   [junit4] Suite: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 2157131 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 2157131 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_623DF12871F4FCD4-001/data-dir-206-001
   [junit4]   2> 2157131 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=135 numCloses=135
   [junit4]   2> 2157131 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2157140 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2157140 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2157140 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2157155 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2157171 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2157180 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2157182 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2159011 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2159012 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4b3a0320[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2159012 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4b3a0320[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2159015 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@197c479[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2159015 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@197c479[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2159016 WARN  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 2159044 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c231fe6
   [junit4]   2> 2159051 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c231fe6
   [junit4]   2> 2159051 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c231fe6
   [junit4]   2> 2159052 INFO  (coreLoadExecutor-20208-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2159059 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2159106 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2159119 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2159122 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2159122 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2159122 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c231fe6
   [junit4]   2> 2159122 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_623DF12871F4FCD4-001/data-dir-206-001/]
   [junit4]   2> 2159123 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=61.12890625, floorSegmentMB=0.2392578125, forceMergeDeletesPctAllowed=8.738597429460436, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=48.87963605249071
   [junit4]   2> 2159165 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2159165 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2159165 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=12.5341796875, floorSegmentMB=1.234375, forceMergeDeletesPctAllowed=0.22316382791752742, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=41.34254692215181
   [junit4]   2> 2159166 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 2159166 INFO  (coreLoadExecutor-20208-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2159167 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159172 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2159176 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumRangeSearch
   [junit4]   2> 2159178 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2159187 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testFacetEnumSearch
   [junit4]   2> 2159187 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159187 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159189 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 1
   [junit4]   2> 2159192 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2159192 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2159192 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2159192 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2159192 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5]} 0 0
   [junit4]   2> 2159197 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159197 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2159413 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml} hits=0 status=0 QTime=215
   [junit4]   2> 2159413 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">215</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 2159414 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">215</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]   2> 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2159415 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testFacetEnumSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=EnumFieldTest -Dtests.method=testFacetEnumSearch -Dtests.seed=623DF12871F4FCD4 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ar-OM -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.24s J2 | EnumFieldTest.testFacetEnumSearch <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([623DF12871F4FCD4:E4FD161DD5129FBD]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]    > 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">215</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]    > </response>
   [junit4]    > 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]    > 	... 45 more
   [junit4]   2> 2159422 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedSetQuery
   [junit4]   2> 2159423 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2159427 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumIndexing
   [junit4]   2> 2159427 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159427 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159428 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159428 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: blabla
   [junit4]   2> 2159428 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159429 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: 145
   [junit4]   2> 2159429 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159429 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: -4
   [junit4]   2> 2159430 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumIndexing
   [junit4]   2> 2159433 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testKnownIntegerEnumIndexing
   [junit4]   2> 2159433 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159433 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159434 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2159434 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2159438 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159438 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2159438 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2159440 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testKnownIntegerEnumIndexing
   [junit4]   2> 2159444 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumSearch
   [junit4]   2> 2159444 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159444 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159444 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2159445 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2159445 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2159445 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2159445 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2159446 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2159446 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2159450 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159450 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2159450 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:bla&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159451 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:7&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159451 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:"-3"&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159452 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumSearch
   [junit4]   2> 2159456 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumSort
   [junit4]   2> 2159456 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumSort
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedEnumSort
   [junit4]    > Assumption #1: Skipping testing of sorting over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2159460 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumSearch
   [junit4]   2> 2159460 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159460 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159461 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2159461 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2159461 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2159462 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2159462 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2159462 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2159462 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2159466 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159466 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2159466 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:bla&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159467 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:7&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159467 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:"-3"&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2159468 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumSearch
   [junit4]   2> 2159472 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumFieldTypeWithoutDocValues
   [junit4]   2> 2159473 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumFieldTypeWithoutDocValues
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumFieldTypeWithoutDocValues
   [junit4]    > Assumption #1: Only testing EnumFieldType without docValues.
   [junit4]   2> 2159476 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2159476 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159476 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159477 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2159477 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2159481 INFO  (searcherExecutor-20210-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2159481 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2159481 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity_mv&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2159483 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2159486 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSort
   [junit4]   2> 2159487 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSort
   [junit4] IGNOR/A 0.00s J2 | EnumFieldTest.testEnumSort
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2159491 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testSetQuery
   [junit4]   2> 2159492 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2159495 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumIndexing
   [junit4]   2> 2159496 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2159496 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2159496 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159496 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: blabla
   [junit4]   2> 2159496 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159497 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: 145
   [junit4]   2> 2159497 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2159497 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: -4
   [junit4]   2> 2159498 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumIndexing
   [junit4]   2> 2159501 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSchema
   [junit4]   2> 2159502 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSchema
   [junit4]   2> 2159505 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumRangeSearch
   [junit4]   2> 2159506 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[623DF12871F4FCD4]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of range searching over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2159507 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2159507 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2051061199
   [junit4]   2> 2159509 INFO  (coreCloseExecutor-20215-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7fde6f3b
   [junit4]   2> 2159509 INFO  (coreCloseExecutor-20215-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@7fde6f3b
   [junit4]   2> 2159509 INFO  (coreCloseExecutor-20215-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7311b7e9: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3de4cb0d
   [junit4]   2> 2159519 INFO  (coreCloseExecutor-20215-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 2159529 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 2159529 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a69f09d: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@25294b78
   [junit4]   2> 2159534 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 2159534 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@48232e5b: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@5e340596
   [junit4]   2> 2159537 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 2159537 INFO  (SUITE-EnumFieldTest-seed#[623DF12871F4FCD4]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b43bf29: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@e2ca957
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_623DF12871F4FCD4-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ar-OM, timezone=America/Port-au-Prince
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=134534728,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestNonDefinedSimilarityFactory, RootFieldTest, QueryElevationComponentTest, TestPKIAuthenticationPlugin, FacetPivotSmallTest, BinaryUpdateRequestHandlerTest, TestFunctionQuery, TestRequestForwarding, SolrShardReporterTest, TestOmitPositions, TestSimGenericDistributedQueue, ZkShardTermsTest, TestCloudRecovery, TestReloadAndDeleteDocs, HealthCheckHandlerTest, HdfsRecoveryZkTest, IndexBasedSpellCheckerTest, V2ApiIntegrationTest, ClassificationUpdateProcessorFactoryTest, PropertiesRequestHandlerTest, FieldMutatingUpdateProcessorTest, DirectoryFactoryTest, LukeRequestHandlerTest, CachingDirectoryFactoryTest, TestReload, TestSolrCloudWithSecureImpersonation, ConvertedLegacyTest, TestManagedResource, SystemLogListenerTest, TestReplicationHandlerBackup, AdminHandlersProxyTest, DistanceFunctionTest, SolrPluginUtilsTest, TestCharFilters, JsonLoaderTest, TestXmlQParser, MoveReplicaTest, SuggestComponentTest, TestLeaderElectionWithEmptyReplica, TestInitParams, TestQueryUtils, TestSchemaResource, TestHdfsUpdateLog, BasicAuthIntegrationTest, TestUtilizeNode, DebugComponentTest, CoreAdminOperationTest, TestSolrCloudWithHadoopAuthPlugin, PeerSyncWithBufferUpdatesTest, HighlighterTest, JWTAuthPluginTest, CollectionsAPIDistributedZkTest, TestTlogReplayVsRecovery, TlogReplayBufferedWhileIndexingTest, PreAnalyzedFieldManagedSchemaCloudTest, RegexBytesRefFilterTest, TestOnReconnectListenerSupport, PeerSyncReplicationTest, TestCursorMarkWithoutUniqueKey, TestBooleanSimilarityFactory, CleanupOldIndexTest, ShardTermsTest, SSLMigrationTest, EchoParamsTest, OrderedExecutorTest, BadCopyFieldTest, TestMinimalConfig, DirectUpdateHandlerTest, TestSimpleQParserPlugin, TestSimDistribStateManager, TestMaxTokenLenTokenizer, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CheckHdfsIndexTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestLegacyFieldReuse, AlternateDirectoryTest, LeaderVoteWaitTimeoutTest, TestFuzzyAnalyzedSuggestions, TestNumericRangeQuery32, SparseHLLTest, TestUtils, TestBadConfig, TestPayloadCheckQParserPlugin, ThreadDumpHandlerTest, NotRequiredUniqueKeyTest, TestPartialUpdateDeduplication, TestUnInvertedFieldException, HdfsCloudIncrementalBackupTest, SpatialHeatmapFacetsTest, AuthToolTest, TestCloudManagedSchema, HttpPartitionTest, RestartWhileUpdatingTest, TestFieldResource, FullHLLTest, TestEmbeddedSolrServerConstructors, AddBlockUpdateTest, TestNestedDocsSort, TestMissingGroups, SpellingQueryConverterTest, TestDocTermOrds, TestBlockCollapse, SolrCloudExampleTest, TestDistributedStatsComponentCardinality, ClusterStateUpdateTest, DeleteShardTest, SOLR749Test, SystemCollectionCompatTest, UUIDUpdateProcessorFallbackTest, SolrRequestParserTest, TestSolrQueryParser, ShardsWhitelistTest, TestComplexPhraseQParserPlugin, DistributedQueryElevationComponentTest, TestCrossCoreJoin, TestDistributedSearch, TestRandomFaceting, AssignBackwardCompatibilityTest, CollectionStateFormat2Test, ConcurrentCreateRoutedAliasTest, ConnectionManagerTest, CreateCollectionCleanupTest, CreateRoutedAliasTest, DeleteInactiveReplicaTest, DistribDocExpirationUpdateProcessorTest, MigrateRouteKeyTest, ReindexCollectionTest, TestConfigSetsAPIExclusivity, TestDeleteCollectionOnDownNodes, TestDistributedMap, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestPullReplica, TestPullReplicaErrorHandling, AssignTest, BackupRestoreApiErrorConditionsTest, CollectionsAPIAsyncDistributedZkTest, TestCollectionAPI, TestReplicaProperties, ComputePlanActionTest, MetricTriggerTest, RestoreTriggerStateTest, ScheduledTriggerTest, TriggerEventQueueTest, TriggerIntegrationTest, TestDynamicURP, TestQuerySenderListener, TestSimpleTextCodec, TestSolrDeletionPolicy1, TestSolrDeletionPolicy2, TestXIncludeConfig, TestSolrCloudSnapshots, TestRestoreCore, TestSQLHandler, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, LoggingHandlerTest, ShowFileRequestHandlerTest, TestConfigsApi, ZookeeperReadAPITest, CustomHighlightComponentTest, DistributedFacetPivotWhiteBoxTest, MoreLikeThisComponentTest, PhrasesIdentificationComponentTest, SearchHandlerTest, SubstringBytesRefFilterTest, TestFaceting, TestMacroExpander, TestMacros, SmileWriterTest, TestPHPSerializedResponseWriter, TestRetrieveFieldsOptimizer, TestSolrQueryResponse, TestExplainDocTransformer, TestSubQueryTransformerDistrib, TestSchemaNameResource, TestSchemaVersionResource, TestUniqueKeyFieldResource, BooleanFieldTest, ChangedSchemaMergeTest, CurrencyFieldTypeTest, DocValuesMissingTest, EnumFieldTest]
   [junit4] Completed [769/934 (1!)] on J2 in 2.62s, 15 tests, 1 error, 7 skipped <<< FAILURES!

[...truncated 51245 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1672 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1672/

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest.testMetricTrigger

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
	at __randomizedtesting.SeedInfo.seed([474D9B647193201A:FD41ACEB2E7BF655]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest.testMetricTrigger(MetricTriggerIntegrationTest.java:195)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14895 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest
   [junit4]   2> 1199381 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1199381 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1199382 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/data-dir-100-001
   [junit4]   2> 1199382 WARN  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=102 numCloses=102
   [junit4]   2> 1199382 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1199384 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1199385 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.SolrCloudTestCase Using per-replica state
   [junit4]   2> 1199385 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001
   [junit4]   2> 1199386 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1199386 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1199386 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1199387 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1199486 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 44687
   [junit4]   2> 1199486 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44687
   [junit4]   2> 1199486 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44687
   [junit4]   2> 1199486 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44687
   [junit4]   2> 1199491 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1199493 INFO  (zkConnectionManagerCallback-14136-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1199493 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1199503 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1199511 INFO  (zkConnectionManagerCallback-14138-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1199511 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1199516 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1199519 INFO  (zkConnectionManagerCallback-14140-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1199519 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1199521 WARN  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker-SendThread(127.0.0.1:44687)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103abea88b70002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1199625 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1199626 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1199626 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1199627 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1199628 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e94b5bf{/solr,null,AVAILABLE}
   [junit4]   2> 1199629 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1199629 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1199629 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1199629 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3bbf726c{/solr,null,AVAILABLE}
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@71702e3f{SSL, (ssl, http/1.1)}{127.0.0.1:44313}
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.e.j.s.Server Started @1199668ms
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44687/solr, hostPort=44313}
   [junit4]   2> 1199630 ERROR (jetty-launcher-14141-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1199630 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-02T22:09:43.021Z
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3a244060{SSL, (ssl, http/1.1)}{127.0.0.1:41173}
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.e.j.s.Server Started @1199669ms
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44687/solr, hostPort=41173}
   [junit4]   2> 1199631 ERROR (jetty-launcher-14141-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1199631 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-02T22:09:43.022Z
   [junit4]   2> 1199632 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1199632 INFO  (zkConnectionManagerCallback-14143-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1199632 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1199633 INFO  (zkConnectionManagerCallback-14145-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1199633 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1199633 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1199635 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1199640 WARN  (jetty-launcher-14141-thread-2-SendThread(127.0.0.1:44687)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103abea88b70004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1199641 WARN  (jetty-launcher-14141-thread-1-SendThread(127.0.0.1:44687)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103abea88b70003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1200572 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1200573 WARN  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1200573 WARN  (jetty-launcher-14141-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5d83c8d5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200573 WARN  (jetty-launcher-14141-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5d83c8d5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200576 WARN  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1200577 WARN  (jetty-launcher-14141-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@105fafdf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200577 WARN  (jetty-launcher-14141-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@105fafdf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200578 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44687/solr
   [junit4]   2> 1200579 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1200583 INFO  (zkConnectionManagerCallback-14159-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1200583 INFO  (jetty-launcher-14141-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1200584 WARN  (jetty-launcher-14141-thread-2-SendThread(127.0.0.1:44687)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103abea88b70005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b70005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1200685 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1200687 INFO  (zkConnectionManagerCallback-14161-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1200687 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1200746 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41173_solr
   [junit4]   2> 1200747 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.Overseer Overseer (id=73091042772451334-127.0.0.1:41173_solr-n_0000000000) starting
   [junit4]   2> 1200752 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41173_solr
   [junit4]   2> 1200753 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41173_solr
   [junit4]   2> 1200754 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1200754 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1200755 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1200756 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1200756 WARN  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1200757 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 1200757 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1200765 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:41173_solr]
   [junit4]   2> 1200767 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 1200767 DEBUG (ScheduledTrigger-14166-thread-1) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 1200767 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1200768 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1200796 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41173.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1200804 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41173.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1200804 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41173.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1200805 INFO  (jetty-launcher-14141-thread-2) [n:127.0.0.1:41173_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node2
   [junit4]   2> 1200867 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1200867 WARN  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1200868 WARN  (jetty-launcher-14141-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@32327e85[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200868 WARN  (jetty-launcher-14141-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@32327e85[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200871 WARN  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1200875 WARN  (jetty-launcher-14141-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5e91403c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200875 WARN  (jetty-launcher-14141-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5e91403c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1200876 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44687/solr
   [junit4]   2> 1200877 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1200879 INFO  (zkConnectionManagerCallback-14181-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1200879 INFO  (jetty-launcher-14141-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1200981 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1200982 INFO  (zkConnectionManagerCallback-14183-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1200982 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1200986 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1200989 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:44313_solr as DOWN
   [junit4]   2> 1200989 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1200989 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44313_solr
   [junit4]   2> 1200990 INFO  (zkCallback-14160-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1200991 INFO  (zkCallback-14182-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1200996 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1200997 WARN  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1201008 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1201065 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44313.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201074 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44313.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201074 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44313.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201075 INFO  (jetty-launcher-14141-thread-1) [n:127.0.0.1:44313_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node1
   [junit4]   2> 1201095 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1201099 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1201100 INFO  (zkConnectionManagerCallback-14196-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1201100 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1201101 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1201102 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44687/solr ready
   [junit4]   2> 1201151 INFO  (qtp1049288101-24850) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 1201200 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1201200 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1201203 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1201203 DEBUG (qtp1977526928-24858) [n:127.0.0.1:41173_solr     ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1201204 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=12
   [junit4]   2> 1201204 DEBUG (zkCallback-14160-thread-1) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1201205 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1201207 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 1201207 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1201225 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMetricTrigger
   [junit4]   2> 1201236 INFO  (OverseerThreadFactory-14168-thread-1-processing-n:127.0.0.1:41173_solr) [n:127.0.0.1:41173_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMetricTrigger
   [junit4]   2> 1201392 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testMetricTrigger_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:41173_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:41173/solr",
   [junit4]   2>   "collection":"testMetricTrigger",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1201394 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testMetricTrigger_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:44313_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:44313/solr",
   [junit4]   2>   "collection":"testMetricTrigger",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1201396 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testMetricTrigger_shard2_replica_n4",
   [junit4]   2>   "node_name":"127.0.0.1:41173_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:41173/solr",
   [junit4]   2>   "collection":"testMetricTrigger",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1201398 INFO  (OverseerStateUpdate-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testMetricTrigger_shard2_replica_n6",
   [junit4]   2>   "node_name":"127.0.0.1:44313_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:44313/solr",
   [junit4]   2>   "collection":"testMetricTrigger",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1201604 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr    x:testMetricTrigger_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n2&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1201609 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr    x:testMetricTrigger_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n1&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1201610 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr    x:testMetricTrigger_shard2_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n4&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1201616 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr    x:testMetricTrigger_shard2_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n6&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1201623 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1201630 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1201637 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1201655 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1201655 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1201656 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1201656 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard2_replica_n4' using configuration from configset conf, trusted=true
   [junit4]   2> 1201657 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41173.solr.core.testMetricTrigger.shard2.replica_n4' (registry 'solr.core.testMetricTrigger.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201657 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrCore [[testMetricTrigger_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node2/testMetricTrigger_shard2_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node2/testMetricTrigger_shard2_replica_n4/data/]
   [junit4]   2> 1201660 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1201660 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1201660 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard1_replica_n1' using configuration from configset conf, trusted=true
   [junit4]   2> 1201660 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41173.solr.core.testMetricTrigger.shard1.replica_n1' (registry 'solr.core.testMetricTrigger.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201661 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrCore [[testMetricTrigger_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node2/testMetricTrigger_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node2/testMetricTrigger_shard1_replica_n1/data/]
   [junit4]   2> 1201663 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1201663 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1201663 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard2_replica_n6' using configuration from configset conf, trusted=true
   [junit4]   2> 1201663 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44313.solr.core.testMetricTrigger.shard2.replica_n6' (registry 'solr.core.testMetricTrigger.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201664 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrCore [[testMetricTrigger_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node1/testMetricTrigger_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node1/testMetricTrigger_shard2_replica_n6/data/]
   [junit4]   2> 1201672 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1201673 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1201673 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard1_replica_n2' using configuration from configset conf, trusted=true
   [junit4]   2> 1201673 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44313.solr.core.testMetricTrigger.shard1.replica_n2' (registry 'solr.core.testMetricTrigger.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1201673 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrCore [[testMetricTrigger_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node1/testMetricTrigger_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node1/testMetricTrigger_shard1_replica_n2/data/]
   [junit4]   2> 1201739 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1201739 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201741 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201741 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201759 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1201759 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201761 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201761 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201764 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1201764 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201764 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1201764 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1201765 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201765 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201765 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1201765 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1201767 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1201767 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201767 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1201767 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1201768 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1201768 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693159768886083584
   [junit4]   2> 1201768 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201768 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1201769 DEBUG (ScheduledTrigger-14166-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 1
   [junit4]   2> 1201769 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1201769 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693159768887132160
   [junit4]   2> 1201770 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201771 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1201771 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693159768889229312
   [junit4]   2> 1201772 INFO  (searcherExecutor-14200-thread-1-processing-n:127.0.0.1:41173_solr x:testMetricTrigger_shard1_replica_n1 c:testMetricTrigger s:shard1 r:core_node3) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrCore [testMetricTrigger_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1201773 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1201774 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1201774 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693159768892375040
   [junit4]   2> 1201774 INFO  (searcherExecutor-14198-thread-1-processing-n:127.0.0.1:41173_solr x:testMetricTrigger_shard2_replica_n4 c:testMetricTrigger s:shard2 r:core_node7) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrCore [testMetricTrigger_shard2_replica_n4]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1201775 INFO  (searcherExecutor-14204-thread-1-processing-n:127.0.0.1:44313_solr x:testMetricTrigger_shard1_replica_n2 c:testMetricTrigger s:shard1 r:core_node5) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrCore [testMetricTrigger_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1201777 INFO  (searcherExecutor-14202-thread-1-processing-n:127.0.0.1:44313_solr x:testMetricTrigger_shard2_replica_n6 c:testMetricTrigger s:shard2 r:core_node8) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrCore [testMetricTrigger_shard2_replica_n6]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1201778 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard2 to Terms{values={core_node7=0}, version=0}
   [junit4]   2> 1201778 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard2
   [junit4]   2> 1201780 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1201780 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard1
   [junit4]   2> 1201782 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 1201782 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard2
   [junit4]   2> 1201784 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1201784 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1201784 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41173/solr/testMetricTrigger_shard2_replica_n4/
   [junit4]   2> 1201785 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 1201785 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard1
   [junit4]   2> 1201786 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard2_replica_n4 url=https://127.0.0.1:41173/solr  START replicas=[https://127.0.0.1:44313/solr/testMetricTrigger_shard2_replica_n6/] nUpdates=100
   [junit4]   2> 1201787 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard2_replica_n4 url=https://127.0.0.1:41173/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1201787 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1201787 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1201787 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41173/solr/testMetricTrigger_shard1_replica_n1/
   [junit4]   2> 1201788 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard1_replica_n1 url=https://127.0.0.1:41173/solr  START replicas=[https://127.0.0.1:44313/solr/testMetricTrigger_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1201788 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard1_replica_n1 url=https://127.0.0.1:41173/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1201794 INFO  (qtp1049288101-24849) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.S.Request [testMetricTrigger_shard2_replica_n6]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1201794 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1201795 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1201795 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testMetricTrigger/leaders/shard2/leader after winning as /collections/testMetricTrigger/leader_elect/shard2/election/73091042772451334-core_node7-n_0000000000
   [junit4]   2> 1201796 INFO  (qtp1049288101-24849) [n:127.0.0.1:44313_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.S.Request [testMetricTrigger_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1201907 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1201907 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1201907 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testMetricTrigger/leaders/shard1/leader after winning as /collections/testMetricTrigger/leader_elect/shard1/election/73091042772451334-core_node3-n_0000000000
   [junit4]   2> 1201909 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41173/solr/testMetricTrigger_shard2_replica_n4/ shard2
   [junit4]   2> 1201910 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41173/solr/testMetricTrigger_shard1_replica_n1/ shard1
   [junit4]   2> 1202012 INFO  (zkCallback-14160-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202013 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1202015 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1202018 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n1&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=409
   [junit4]   2> 1202019 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n4&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=409
   [junit4]   2> 1202118 INFO  (zkCallback-14160-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202119 INFO  (zkCallback-14160-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202771 DEBUG (ScheduledTrigger-14166-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 1202791 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n6&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1175
   [junit4]   2> 1202792 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n2&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1188
   [junit4]   2> 1202794 INFO  (qtp1977526928-24861) [n:127.0.0.1:41173_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1202894 INFO  (zkCallback-14182-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202894 INFO  (zkCallback-14160-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202894 INFO  (zkCallback-14160-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202894 INFO  (zkCallback-14182-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1202895 INFO  (qtp1977526928-24861) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=2&name=testMetricTrigger&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1663
   [junit4]   2> 1202895 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testMetricTrigger
   [junit4]   2> 1202908 INFO  (qtp1977526928-24860) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard2.replica_n4:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202910 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1202911 INFO  (qtp1049288101-24853) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard2.replica_n6:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202912 INFO  (qtp1049288101-24850) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1202912 DEBUG (qtp1977526928-24859) [n:127.0.0.1:41173_solr     ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1202913 INFO  (qtp1977526928-24859) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=12
   [junit4]   2> 1202914 DEBUG (zkCallback-14160-thread-1) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1202914 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1202917 INFO  (qtp1977526928-24861) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard2.replica_n4:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202917 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 1202918 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1202918 INFO  (qtp1977526928-24860) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1202919 INFO  (qtp1049288101-24849) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202920 INFO  (qtp1049288101-24851) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard2.replica_n6:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202920 INFO  (qtp1977526928-24862) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1202921 INFO  (qtp1049288101-24852) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1202924 DEBUG (qtp1977526928-24859) [n:127.0.0.1:41173_solr     ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1202925 INFO  (qtp1977526928-24859) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 1202926 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1202926 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1202926 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1202927 DEBUG (zkCallback-14160-thread-1) [     ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 1202927 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 1202928 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
   [junit4]   2> 1202928 DEBUG (OverseerAutoScalingTriggerThread-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 1202932 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1202932 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1202932 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1202932 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@48fe44f3{/solr,null,AVAILABLE}
   [junit4]   2> 1202935 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@281485d8{SSL, (ssl, http/1.1)}{127.0.0.1:41159}
   [junit4]   2> 1202935 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.Server Started @1202973ms
   [junit4]   2> 1202935 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44687/solr, hostPort=41159}
   [junit4]   2> 1202935 ERROR (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1202936 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1202936 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1202936 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1202936 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1202936 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-02T22:09:46.327Z
   [junit4]   2> 1202939 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1202940 INFO  (zkConnectionManagerCallback-14222-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1202940 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1202941 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1202946 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]-SendThread(127.0.0.1:44687)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103abea88b7000a.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b7000a, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103abea88b7000a, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1203237 INFO  (OverseerCollectionConfigSetProcessor-73091042772451334-127.0.0.1:41173_solr-n_0000000000) [n:127.0.0.1:41173_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1203771 DEBUG (ScheduledTrigger-14166-thread-2) [     ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 1203803 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1203804 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1203805 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@70047981[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1203805 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@70047981[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1203807 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1203808 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@52c62143[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1203808 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@52c62143[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1203810 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44687/solr
   [junit4]   2> 1203811 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1203811 INFO  (zkConnectionManagerCallback-14233-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1203811 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1203914 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1203915 INFO  (zkConnectionManagerCallback-14235-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1203915 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1203920 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1203923 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:41159_solr as DOWN
   [junit4]   2> 1203925 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1203925 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41159_solr
   [junit4]   2> 1203926 INFO  (qtp1049288101-24853) [n:127.0.0.1:44313_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1203928 INFO  (qtp1977526928-24858) [n:127.0.0.1:41173_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 1203928 INFO  (zkCallback-14195-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1203928 INFO  (zkCallback-14182-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1203928 INFO  (zkCallback-14160-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1203930 INFO  (zkCallback-14234-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1203930 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1203931 WARN  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1203942 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1203962 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41159.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1203973 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41159.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1203973 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41159.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e973e16
   [junit4]   2> 1203974 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [n:127.0.0.1:41159_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001/tempDir-001/node3
   [junit4]   2> 1204000 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1204000 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1204000 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1204001 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1204001 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1204001 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1204001 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6bc58e7a{/solr,null,AVAILABLE}
   [junit4]   2> 1204002 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@12ccdb8e{SSL, (ssl, http/1.1)}{127.0.0.1:33765}
   [junit4]   2> 1204002 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.e.j.s.Server Started @1204041ms
   [junit4]   2> 1204002 INFO  (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44687/solr, hostPort=33765}
   [junit4]   2> 1204002 ERROR (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[474D9B647193201A]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete

[...truncated too long message...]

.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1235460 INFO  (jetty-closer-14283-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@281485d8{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1235460 INFO  (jetty-closer-14283-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48fe44f3{/solr,null,STOPPED}
   [junit4]   2> 1235460 INFO  (jetty-closer-14283-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1235554 INFO  (jetty-closer-14283-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@71702e3f{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1235555 INFO  (jetty-closer-14283-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1e94b5bf{/solr,null,STOPPED}
   [junit4]   2> 1235555 INFO  (jetty-closer-14283-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1235559 INFO  (jetty-closer-14283-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73091042772451334-127.0.0.1:41173_solr-n_0000000000) closing
   [junit4]   2> 1235560 INFO  (jetty-closer-14283-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@3a244060{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1235560 INFO  (jetty-closer-14283-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3bbf726c{/solr,null,STOPPED}
   [junit4]   2> 1235560 INFO  (jetty-closer-14283-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1235660 INFO  (jetty-closer-14283-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@12ccdb8e{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1235661 INFO  (jetty-closer-14283-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6bc58e7a{/solr,null,STOPPED}
   [junit4]   2> 1235661 INFO  (jetty-closer-14283-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1235662 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1235865 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	30	/solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2> 	7	/solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf
   [junit4]   2> 	4	/solr/collections/testMetricTrigger/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	93	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/73091042772451336-127.0.0.1:44313_solr-n_0000000001
   [junit4]   2> 	2	/solr/collections/testMetricTrigger/leader_elect/shard1/election/73091042772451336-core_node5-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	53	/solr/overseer/queue
   [junit4]   2> 	22	/solr/live_nodes
   [junit4]   2> 	17	/solr/collections/testMetricTrigger/state.json
   [junit4]   2> 	8	/solr/collections
   [junit4]   2> 	8	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/metric_trigger
   [junit4]   2> 
   [junit4]   2> 1235867 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:44687
   [junit4]   2> 1235868 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44687
   [junit4]   2> 1235868 INFO  (SUITE-MetricTriggerIntegrationTest-seed#[474D9B647193201A]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44687
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_474D9B647193201A-001
   [junit4]   2> Mar 02, 2021 10:10:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {_root_=Lucene84, id=PostingsFormat(name=Direct), x_s=Lucene84}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1960, maxMBSortInHeap=5.087469259694917, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=en-MT, timezone=Pacific/Marquesas
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=155100128,total=522190848
   [junit4]   2> NOTE: All tests run in this JVM: [TestPullReplicaErrorHandling, TestJoin, OverseerCollectionConfigSetProcessorTest, TestManagedSchemaThreadSafety, CdcrBootstrapTest, TestMergePolicyConfig, CustomCollectionTest, TestEmbeddedSolrServerAdminHandler, VersionInfoTest, StressHdfsTest, CdcrVersionReplicationTest, SuggestComponentContextFilterQueryTest, LoggingHandlerTest, XsltUpdateRequestHandlerTest, TestValueSourceCache, TestClusterProperties, SearchHandlerTest, CreateRoutedAliasTest, CategoryRoutedAliasUpdateProcessorTest, TestSimNodeLostTrigger, ResourceLoaderTest, TestHttpServletCarrier, TestLegacyField, DistribDocExpirationUpdateProcessorTest, DirectoryFactoriesTest, TestLegacyBM25SimilarityFactory, TaggingAttributeTest, TestUninvertingReader, SecurityHeadersTest, HighlighterMaxOffsetTest, TestFieldCacheReopen, DistributedFacetExistsSmallTest, TestRecoveryHdfs, HttpPartitionOnCommitTest, DateMathParserTest, AuditLoggerPluginTest, OverseerSolrResponseUnsafeSerializationTest, BJQFilterAccessibleTest, TestInPlaceUpdatesRequiredField, SystemInfoHandlerTest, PackageManagerCLITest, TestPivotHelperCode, SignificantTermsQParserPluginTest, TestUseDocValuesAsStored, TestFieldCollectionResource, PeerSyncTest, DocValuesNotIndexedTest, JavaBinAtomicUpdateMultivalueTest, QueryParsingTest, TestFieldCacheWithThreads, TestCloudDeleteByQuery, RankFieldTest, ByteBuffersDirectoryFactoryTest, TestShortCircuitedRequests, TestPackages, TestConfigSetsAPIZkFailure, TestDynamicLoading, PurgeGraphTest, TestStressVersions, TestSolrXml, TestSolrConfigHandlerCloud, HdfsLockFactoryTest, TestMultiValuedNumericRangeQuery, CollectionsAPIAsyncDistributedZkTest, AnalyticsQueryTest, HttpTriggerListenerTest, TestReplicaProperties, TestSolrConfigHandler, TestCoreContainer, HdfsThreadLeakTest, ZkNodePropsTest, TestDocSet, ZookeeperStatusHandlerTest, TestBackupRepositoryFactory, DocExpirationUpdateProcessorFactoryTest, TestCSVResponseWriter, SolrIndexConfigTest, ChangedSchemaMergeTest, CustomTermsComponentTest, TestFreeTextSuggestions, TestDFRSimilarityFactory, LeaderElectionIntegrationTest, ClusterStateTest, DistributedQueryComponentOptimizationTest, TestMinHashQParser, RequestLoggingTest, TriggerEventQueueTest, TestImpersonationWithHadoopAuth, TestJavabinTupleStreamParser, CloneFieldUpdateProcessorFactoryTest, TestManagedSynonymGraphFilterFactory, ProtectedTermFilterFactoryTest, TestMiniSolrCloudClusterSSL, TestCloudJSONFacetSKGEquiv, TestInfoStreamLogging, AssignBackwardCompatibilityTest, CollectionsAPISolrJTest, MetricTriggerIntegrationTest]
   [junit4] Completed [464/934 (1!)] on J1 in 36.91s, 1 test, 1 failure <<< FAILURES!

[...truncated 52262 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1671 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1671/

1 tests failed.
FAILED:  org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([EACFDD81A4921E93:6C0F3AB400747DFA]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
</response>

	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
	... 45 more




Build Log:
[...truncated 15874 lines...]
   [junit4] Suite: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 2188617 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 2188618 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2188618 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_EACFDD81A4921E93-001/data-dir-171-001
   [junit4]   2> 2188618 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
   [junit4]   2> 2188618 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2188620 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2188620 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2188625 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2188643 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2188651 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2188653 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2190693 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2190694 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 2190694 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@77a4075a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2190694 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@77a4075a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2190697 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 2190698 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@714edffc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2190698 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@714edffc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2190699 WARN  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 2190728 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e7fe748
   [junit4]   2> 2190735 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e7fe748
   [junit4]   2> 2190735 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e7fe748
   [junit4]   2> 2190736 INFO  (coreLoadExecutor-22584-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2190743 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2190760 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2190777 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2190779 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2190779 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2190779 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4e7fe748
   [junit4]   2> 2190779 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_EACFDD81A4921E93-001/data-dir-171-001/]
   [junit4]   2> 2190781 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2190816 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2190816 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2190817 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.13711583269053584]
   [junit4]   2> 2190818 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 2190818 INFO  (coreLoadExecutor-22584-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2190819 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2190824 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2190824 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2190824 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2190825 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2190826 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2190827 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2190831 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2190832 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 2190832 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity_mv&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2190833 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2190979 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumSearch
   [junit4]   2> 2190979 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2190979 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2190979 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2190980 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2190980 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2190980 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2190980 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2190981 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2190981 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2190985 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2190985 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2190985 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:bla&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2190986 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:7&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2190986 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:"-3"&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2190987 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumSearch
   [junit4]   2> 2190991 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testFacetEnumSearch
   [junit4]   2> 2190992 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2190992 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2190992 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2190992 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2190992 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2190993 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2190993 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2190993 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5]} 0 0
   [junit4]   2> 2190997 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2190997 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2190997 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2190998 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 2190998 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]   2> 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2190999 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testFacetEnumSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=EnumFieldTest -Dtests.method=testFacetEnumSearch -Dtests.seed=EACFDD81A4921E93 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=uk-UA -Dtests.timezone=Asia/Anadyr -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.01s J2 | EnumFieldTest.testFacetEnumSearch <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EACFDD81A4921E93:6C0F3AB400747DFA]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]    > 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]    > </response>
   [junit4]    > 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]    > 	... 45 more
   [junit4]   2> 2191005 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumRangeSearch
   [junit4]   2> 2191006 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2191010 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumIndexing
   [junit4]   2> 2191010 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2191011 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2191011 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191011 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: blabla
   [junit4]   2> 2191011 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191012 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: 145
   [junit4]   2> 2191012 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191012 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: -4
   [junit4]   2> 2191013 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumIndexing
   [junit4]   2> 2191017 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSort
   [junit4]   2> 2191018 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSort
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumSort
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2191022 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSchema
   [junit4]   2> 2191023 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSchema
   [junit4]   2> 2191027 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testSetQuery
   [junit4]   2> 2191027 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2191033 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testKnownIntegerEnumIndexing
   [junit4]   2> 2191033 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2191033 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2191033 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2191034 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2191037 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2191037 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2191038 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2191039 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testKnownIntegerEnumIndexing
   [junit4]   2> 2191043 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumSort
   [junit4]   2> 2191044 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumSort
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedEnumSort
   [junit4]    > Assumption #1: Skipping testing of sorting over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2191048 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumFieldTypeWithoutDocValues
   [junit4]   2> 2191049 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumFieldTypeWithoutDocValues
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumFieldTypeWithoutDocValues
   [junit4]    > Assumption #1: Only testing EnumFieldType without docValues.
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumIndexing
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: blabla
   [junit4]   2> 2191054 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191055 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: 145
   [junit4]   2> 2191055 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2191055 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: -4
   [junit4]   2> 2191056 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumIndexing
   [junit4]   2> 2191060 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumRangeSearch
   [junit4]   2> 2191060 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of range searching over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2191065 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedSetQuery
   [junit4]   2> 2191065 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2191070 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumSearch
   [junit4]   2> 2191070 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2191070 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2191070 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2191073 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 2
   [junit4]   2> 2191073 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2191073 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2191073 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2191074 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2191074 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2191077 INFO  (searcherExecutor-22586-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2191077 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2191077 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:bla&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2191078 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:7&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2191078 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:"-3"&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2191079 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[EACFDD81A4921E93]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumSearch
   [junit4]   2> 2191079 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2191079 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=881943490
   [junit4]   2> 2191079 INFO  (coreCloseExecutor-22591-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5b3ce240
   [junit4]   2> 2191080 INFO  (coreCloseExecutor-22591-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@5b3ce240
   [junit4]   2> 2191080 INFO  (coreCloseExecutor-22591-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a8c69f4: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@17899c69
   [junit4]   2> 2191090 INFO  (coreCloseExecutor-22591-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 2191091 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 2191092 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34483936: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@2ffad8ff
   [junit4]   2> 2191097 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 2191097 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@74b5cf73: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@656fa528
   [junit4]   2> 2191099 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 2191099 INFO  (SUITE-EnumFieldTest-seed#[EACFDD81A4921E93]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2829a7dd: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@7d488e6a
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_EACFDD81A4921E93-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {severity_missingFirst=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), severity_missingLast=PostingsFormat(name=LuceneVarGapFixedInterval), id=FST50}, docValues:{}, maxPointsInLeafNode=837, maxMBSortInHeap=7.23271617347805, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=uk-UA, timezone=Asia/Anadyr
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=127671880,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimpleQParserPlugin, TestSurroundQueryParser, SolrCloudExampleTest, SolrIndexMetricsTest, TestTlogReplayVsRecovery, TestNestedDocsSort, SolrIndexSearcherTest, TestUtils, MetricTriggerTest, NodeMutatorTest, NestedAtomicUpdateTest, XmlInterpolationTest, RestartWhileUpdatingTest, TestDownShardTolerantSearch, SSLMigrationTest, DeleteShardTest, CdcrOpsAndBoundariesTest, CleanupOldIndexTest, TestInPlaceUpdatesStandalone, TlogReplayBufferedWhileIndexingTest, TestUtilizeNode, PreAnalyzedFieldManagedSchemaCloudTest, TestSolrQueryParser, SolrMetricManagerTest, ZkShardTermsTest, DistanceUnitsTest, TestExactStatsCache, HdfsCloudIncrementalBackupTest, BinaryUpdateRequestHandlerTest, TestPayloadCheckQParserPlugin, TestManagedResource, TestLegacyFieldCache, TestLegacyFieldReuse, SolrJmxReporterCloudTest, TestDocumentBuilder, TestFuzzyAnalyzedSuggestions, ShardsWhitelistTest, NotRequiredUniqueKeyTest, TestUnifiedSolrHighlighterWithoutStoredId, CopyFieldTest, TestCharFilters, AdminHandlersProxyTest, DeleteInactiveReplicaTest, TestLRUCache, TestFieldCacheSort, TestSchemaResource, PeerSyncReplicationTest, TestBlockCollapse, JSONWriterTest, TransactionLogTest, PropertiesRequestHandlerTest, TestUseDocValuesAsStored2, TestSchemalessBufferedUpdates, HealthCheckHandlerTest, TestSolrConfigHandlerConcurrent, RootFieldTest, BadComponentTest, CollectionsAPIDistributedZkTest, TestFilteredDocIdSet, LeaderElectionTest, HttpPartitionTest, TestWordDelimiterFilterFactory, TestQueryingOnDownCollection, MaxScoreCollectorTest, ConvertedLegacyTest, TestHalfAndHalfDocValues, TestRetrieveFieldsOptimizer, BasicDistributedZk2Test, TestHdfsUpdateLog, SystemLogListenerTest, TestEmbeddedSolrServerConstructors, TestCustomDocTransformer, SolrShardReporterTest, DocValuesMissingTest, EchoParamsTest, CdcrWithNodesRestartsTest, TestLeaderElectionWithEmptyReplica, DefaultValueUpdateProcessorTest, DebugComponentTest, SystemCollectionCompatTest, BigEndianAscendingWordDeserializerTest, TestConfigSetsAPI, ShardSplitTest, CachingDirectoryFactoryTest, RankQParserPluginTest, AddBlockUpdateTest, MoveReplicaTest, TestReRankQParserPlugin, AuthToolTest, TestComplexPhraseQParserPlugin, TestQueryUtils, TestFaceting, TestJsonFacetErrors, TestSolrCachePerf, TestRequestStatusCollectionAPI, TestCopyFieldCollectionResource, TestMissingGroups, TestTolerantSearch, ClusterStateUpdateTest, TestSolrCLIRunExample, BlockDirectoryTest, TestExplainDocTransformer, OrderedExecutorTest, PKIAuthenticationIntegrationTest, CheckHdfsIndexTest, TestNumericRangeQuery32, OverseerModifyCollectionTest, TestApiFramework, ZkCLITest, TestJsonFacetsWithNestedObjects, JsonLoaderTest, QueryResultKeyTest, SpellingQueryConverterTest, TestSimPolicyCloud, ChaosMonkeySafeLeaderWithPullReplicasTest, ForceLeaderTest, ForceLeaderWithTlogReplicasTest, LeaderVoteWaitTimeoutTest, OverseerStatusTest, OverseerTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, TestCloudInspectUtil, TestCloudPhrasesIdentificationComponent, TestCloudPseudoReturnFields, TestCloudRecovery, TestCloudSearcherWarming, TestRequestForwarding, TestSSLRandomization, TestShortCircuitedRequests, TestSolrCloudWithSecureImpersonation, TestStressCloudBlindAtomicUpdates, TestTolerantUpdateProcessorRandomCloud, TestZkChroot, VMParamsZkACLAndCredentialsProvidersTest, BackupRestoreApiErrorConditionsTest, CollectionReloadTest, TestCollectionsAPIViaSolrCloudCluster, TestReplicaProperties, AutoScalingHandlerTest, ExecutePlanActionTest, NodeAddedTriggerTest, NodeMarkersRegistrationTest, ScheduledTriggerIntegrationTest, TriggerIntegrationTest, TestConfig, TestConfigSetImmutable, TestCorePropertiesReload, TestDynamicLoadingUrl, TestInfoStreamLogging, TestMinimalConfig, TestQuerySenderListener, TestShardHandlerFactory, TestSolrDeletionPolicy2, HdfsBackupRepositoryIntegrationTest, TestDistribPackageStore, TestHdfsBackupRestoreCore, TestReplicationHandlerDiskOverFlow, TestSolrConfigHandlerCloud, ThreadDumpHandlerTest, CustomTermsComponentTest, DistributedFacetPivotLongTailTest, DistributedQueryComponentCustomSortTest, MoreLikeThisComponentTest, PhrasesIdentificationComponentTest, QueryElevationComponentTest, TermVectorComponentDistributedTest, JavabinLoaderTest, EmbeddedSolrNoSerializeTest, RandomizedTaggerTest, TaggerTest, TestLegacyField, JvmMetricsTest, SolrSlf4jReporterTest, TestStreamBody, TestPushWriter, TestChildDocTransformerHierarchy, TestFieldTypeCollectionResource, TestManagedSynonymFilterFactory, ChangedSchemaMergeTest, EnumFieldTest]
   [junit4] Completed [763/934 (1!)] on J2 in 2.63s, 15 tests, 1 error, 7 skipped <<< FAILURES!

[...truncated 51297 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1670 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1670/

All tests passed

Build Log:
[...truncated 67167 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 68 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1669 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1669/

All tests passed

Build Log:
[...truncated 67161 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1668 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1668/

1 tests failed.
FAILED:  org.apache.solr.search.TestRecovery.stressLogReplay

Error Message:
mismatch: '52'!='53' @ response/numFound

Stack Trace:
java.lang.RuntimeException: mismatch: '52'!='53' @ response/numFound
	at __randomizedtesting.SeedInfo.seed([70ADDA08C7924120:B50339A110045662]:0)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1109)
	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1058)
	at org.apache.solr.search.TestRecovery.stressLogReplay(TestRecovery.java:172)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13989 lines...]
   [junit4] Suite: org.apache.solr.search.TestRecovery
   [junit4]   2> 588366 INFO  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 588366 INFO  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 588366 INFO  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-54-001
   [junit4]   2> 588366 WARN  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
   [junit4]   2> 588366 INFO  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 588368 INFO  (SUITE-TestRecovery-seed#[70ADDA08C7924120]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 588371 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###Starting stressLogReplay
   [junit4]   2> 588371 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 updateLog impl=solr.CdcrUpdateLog
   [junit4]   2> 588371 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 588377 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 588390 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 588402 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 588404 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 589947 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 589948 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 589949 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61109ca4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 589949 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61109ca4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 589951 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 589952 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4480d072[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 589952 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4480d072[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 589953 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 589980 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 589987 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 589987 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 589988 INFO  (coreLoadExecutor-4513-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 589997 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 590013 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 590043 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 590045 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 590052 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 590052 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 590052 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-54-001/]
   [junit4]   2> 590054 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=84.689453125, floorSegmentMB=2.115234375, forceMergeDeletesPctAllowed=20.38689924920731, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24188149119689228, deletesPctAllowed=28.17312435636126
   [junit4]   2> 590068 WARN  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 590119 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 590119 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 590120 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 590120 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 590121 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=41.6455078125, floorSegmentMB=0.79296875, forceMergeDeletesPctAllowed=6.94312343297497, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=43.79740501738344
   [junit4]   2> 590123 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 590124 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 590124 INFO  (coreLoadExecutor-4513-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693084730112606208
   [junit4]   2> 590126 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 590127 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 590129 INFO  (searcherExecutor-4515-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 590129 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 2
   [junit4]   2> 590145 INFO  (searcherExecutor-4515-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 590145 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 15
   [junit4]   2> 590151 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2345 (1693084730136723456)]} 0 3
   [junit4]   2> 590151 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[3253 (1693084730140917760)]} 0 0
   [junit4]   2> 590151 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[969 (1693084730140917761)]} 0 0
   [junit4]   2> 590152 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6400 (1693084730141966336)]} 0 0
   [junit4]   2> 590152 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1929 (1693084730141966337)]} 0 0
   [junit4]   2> 590152 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6583 (1693084730141966338)]} 0 0
   [junit4]   2> 590152 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6680 (1693084730141966339)]} 0 0
   [junit4]   2> 590153 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2006 (1693084730141966340)]} 0 0
   [junit4]   2> 590153 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6269 (1693084730143014912)]} 0 0
   [junit4]   2> 590153 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4894 (1693084730143014913)]} 0 0
   [junit4]   2> 590153 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[994 (1693084730143014914)]} 0 0
   [junit4]   2> 590155 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4894 (1693084730145112064)]} 0 0
   [junit4]   2> 590155 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7184 (1693084730145112065)]} 0 0
   [junit4]   2> 590165 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:523 (-1693084730145112066)} 0 9
   [junit4]   2> 590166 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7695 (1693084730155597824)]} 0 0
   [junit4]   2> 590166 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8036 (1693084730156646400)]} 0 0
   [junit4]   2> 590166 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8036 (1693084730156646401)]} 0 0
   [junit4]   2> 590172 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:558 (-1693084730156646402)} 0 5
   [junit4]   2> 590173 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2108 (1693084730162937856)]} 0 0
   [junit4]   2> 590173 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[969 (-1693084730163986432)]} 0 0
   [junit4]   2> 590173 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4559 (1693084730163986433)]} 0 0
   [junit4]   2> 590173 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7907 (1693084730163986434)]} 0 0
   [junit4]   2> 590174 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6680 (1693084730165035008)]} 0 0
   [junit4]   2> 590174 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[2006 (-1693084730165035009)]} 0 0
   [junit4]   2> 590174 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1929 (1693084730165035010)]} 0 0
   [junit4]   2> 590175 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6583 (1693084730165035011)]} 0 0
   [junit4]   2> 590175 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[138 (1693084730166083584)]} 0 0
   [junit4]   2> 590175 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[113 (1693084730166083585)]} 0 0
   [junit4]   2> 590175 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[3253 (1693084730166083586)]} 0 0
   [junit4]   2> 590175 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6471 (1693084730166083587)]} 0 0
   [junit4]   2> 590176 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5277 (1693084730167132160)]} 0 0
   [junit4]   2> 590176 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5519 (1693084730167132161)]} 0 0
   [junit4]   2> 590176 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9192 (1693084730167132162)]} 0 0
   [junit4]   2> 590176 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[2108 (-1693084730167132163)]} 0 0
   [junit4]   2> 590176 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[6269 (-1693084730167132164)]} 0 0
   [junit4]   2> 590177 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5611 (1693084730168180736)]} 0 0
   [junit4]   2> 590177 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6471 (1693084730168180737)]} 0 0
   [junit4]   2> 590177 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7907 (1693084730168180738)]} 0 0
   [junit4]   2> 590177 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5357 (1693084730168180739)]} 0 0
   [junit4]   2> 590177 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4380 (1693084730168180740)]} 0 0
   [junit4]   2> 590178 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[6471 (-1693084730169229312)]} 0 0
   [junit4]   2> 590178 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1929 (1693084730169229313)]} 0 0
   [junit4]   2> 590178 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[994 (1693084730169229314)]} 0 0
   [junit4]   2> 590178 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6680 (1693084730169229315)]} 0 0
   [junit4]   2> 590179 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7753 (1693084730169229316)]} 0 0
   [junit4]   2> 590179 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1929 (1693084730170277888)]} 0 0
   [junit4]   2> 590187 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:877 (-1693084730170277889)} 0 8
   [junit4]   2> 590188 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7863 (1693084730179715072)]} 0 0
   [junit4]   2> 590188 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5277 (1693084730179715073)]} 0 0
   [junit4]   2> 590189 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[7695 (-1693084730180763648)]} 0 0
   [junit4]   2> 590189 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5357 (1693084730180763649)]} 0 0
   [junit4]   2> 590189 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5277 (1693084730180763650)]} 0 0
   [junit4]   2> 590189 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1929 (1693084730180763651)]} 0 0
   [junit4]   2> 590190 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6479 (1693084730181812224)]} 0 0
   [junit4]   2> 590190 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5611 (1693084730181812225)]} 0 0
   [junit4]   2> 590190 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5747 (1693084730181812226)]} 0 0
   [junit4]   2> 590198 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:813 (-1693084730181812227)} 0 8
   [junit4]   2> 590199 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4229 (1693084730191249408)]} 0 0
   [junit4]   2> 590199 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7753 (1693084730191249409)]} 0 0
   [junit4]   2> 590200 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6109 (1693084730192297984)]} 0 0
   [junit4]   2> 590200 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5945 (1693084730192297985)]} 0 0
   [junit4]   2> 590200 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2154 (1693084730192297986)]} 0 0
   [junit4]   2> 590200 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4380 (1693084730192297987)]} 0 0
   [junit4]   2> 590200 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[113 (-1693084730192297988)]} 0 0
   [junit4]   2> 590201 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[138 (1693084730193346560)]} 0 0
   [junit4]   2> 590201 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2455 (1693084730193346561)]} 0 0
   [junit4]   2> 590201 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2763 (1693084730193346562)]} 0 0
   [junit4]   2> 590201 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1043 (1693084730193346563)]} 0 0
   [junit4]   2> 590202 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8036 (1693084730194395136)]} 0 0
   [junit4]   2> 590202 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7863 (1693084730194395137)]} 0 0
   [junit4]   2> 590202 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4026 (1693084730194395138)]} 0 0
   [junit4]   2> 590212 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:104 (-1693084730194395139)} 0 9
   [junit4]   2> 590212 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1295 (1693084730204880896)]} 0 0
   [junit4]   2> 590213 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1039 (1693084730204880897)]} 0 0
   [junit4]   2> 590213 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[3253 (1693084730205929472)]} 0 0
   [junit4]   2> 590213 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2154 (1693084730205929473)]} 0 0
   [junit4]   2> 590213 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2345 (1693084730205929474)]} 0 0
   [junit4]   2> 590214 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9589 (1693084730206978048)]} 0 0
   [junit4]   2> 590214 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9161 (1693084730206978049)]} 0 0
   [junit4]   2> 590214 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7462 (1693084730206978050)]} 0 0
   [junit4]   2> 590214 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6680 (1693084730206978051)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[138 (1693084730206978052)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1597 (1693084730208026624)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[958 (1693084730208026625)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7462 (1693084730208026626)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[2154 (-1693084730208026627)]} 0 0
   [junit4]   2> 590215 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[6583 (-1693084730208026628)]} 0 0
   [junit4]   2> 590216 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[7462 (-1693084730209075200)]} 0 0
   [junit4]   2> 590216 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8036 (1693084730209075201)]} 0 0
   [junit4]   2> 590216 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7093 (1693084730209075202)]} 0 0
   [junit4]   2> 590216 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8275 (1693084730209075203)]} 0 0
   [junit4]   2> 590216 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8867 (1693084730209075204)]} 0 0
   [junit4]   2> 590217 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9161 (1693084730210123776)]} 0 0
   [junit4]   2> 590217 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5519 (1693084730210123777)]} 0 0
   [junit4]   2> 590217 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9263 (1693084730210123778)]} 0 0
   [junit4]   2> 590217 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[109 (1693084730210123779)]} 0 0
   [junit4]   2> 590217 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5277 (1693084730210123780)]} 0 0
   [junit4]   2> 590218 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5357 (1693084730211172352)]} 0 0
   [junit4]   2> 590218 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8694 (1693084730211172353)]} 0 0
   [junit4]   2> 590218 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7863 (1693084730211172354)]} 0 0
   [junit4]   2> 590218 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2375 (1693084730211172355)]} 0 0
   [junit4]   2> 590218 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4559 (1693084730211172356)]} 0 0
   [junit4]   2> 590219 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1011 (1693084730212220928)]} 0 0
   [junit4]   2> 590219 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[216 (1693084730212220929)]} 0 0
   [junit4]   2> 590219 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8275 (1693084730212220930)]} 0 0
   [junit4]   2> 590219 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9263 (1693084730212220931)]} 0 0
   [junit4]   2> 590219 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2828 (1693084730212220932)]} 0 0
   [junit4]   2> 590220 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4229 (1693084730213269504)]} 0 0
   [junit4]   2> 590220 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2380 (1693084730213269505)]} 0 0
   [junit4]   2> 590220 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5519 (1693084730213269506)]} 0 0
   [junit4]   2> 590220 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5076 (1693084730213269507)]} 0 0
   [junit4]   2> 590221 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5945 (1693084730213269508)]} 0 0
   [junit4]   2> 590221 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[1597 (-1693084730214318080)]} 0 0
   [junit4]   2> 590235 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:662 (-1693084730214318081)} 0 14
   [junit4]   2> 590236 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7571 (1693084730228998144)]} 0 0
   [junit4]   2> 590236 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2380 (1693084730230046720)]} 0 0
   [junit4]   2> 590237 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8275 (1693084730231095296)]} 0 0
   [junit4]   2> 590237 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6702 (1693084730231095297)]} 0 0
   [junit4]   2> 590237 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6479 (1693084730231095298)]} 0 0
   [junit4]   2> 590237 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5076 (1693084730231095299)]} 0 0
   [junit4]   2> 590237 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8971 (1693084730231095300)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1011 (1693084730232143872)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2957 (1693084730232143873)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5281 (1693084730232143874)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[994 (-1693084730232143875)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2240 (1693084730232143876)]} 0 0
   [junit4]   2> 590238 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[8275 (-1693084730232143877)]} 0 0
   [junit4]   2> 590239 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[1905 (1693084730233192448)]} 0 0
   [junit4]   2> 590239 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2957 (1693084730233192449)]} 0 0
   [junit4]   2> 590239 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[6292 (1693084730233192450)]} 0 0
   [junit4]   2> 590239 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[109 (1693084730233192451)]} 0 0
   [junit4]   2> 590239 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7367 (1693084730233192452)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[788 (1693084730234241024)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8503 (1693084730234241025)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[3203 (1693084730234241026)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[9583 (1693084730234241027)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[788 (-1693084730234241028)]} 0 0
   [junit4]   2> 590240 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4818 (1693084730234241029)]} 0 0
   [junit4]   2> 590241 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[7753 (1693084730235289600)]} 0 0
   [junit4]   2> 590241 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8155 (1693084730235289601)]} 0 0
   [junit4]   2> 590241 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4818 (1693084730235289602)]} 0 0
   [junit4]   2> 590253 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=val_i_dvo:757 (-1693084730235289603)} 0 11
   [junit4]   2> 590253 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4026 (1693084730247872512)]} 0 0
   [junit4]   2> 590254 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[4831 (1693084730247872513)]} 0 0
   [junit4]   2> 590254 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[5945 (-1693084730248921088)]} 0 0
   [junit4]   2> 590254 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[3681 (1693084730248921089)]} 0 0
   [junit4]   2> 590254 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[8971 (1693084730248921090)]} 0 0
   [junit4]   2> 590255 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{delete=[4818 (-1693084730249969664)]} 0 0
   [junit4]   2> 590255 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[5407 (1693084730249969665)]} 0 0
   [junit4]   2> 590255 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[2455 (1693084730249969666)]} 0 0
   [junit4]   2> 590255 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1851979368
   [junit4]   2> 590256 INFO  (coreCloseExecutor-4521-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1bb469a9
   [junit4]   2> 590256 INFO  (coreCloseExecutor-4521-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1bb469a9
   [junit4]   2> 590256 INFO  (coreCloseExecutor-4521-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@40d8bafe: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@15c6ce88
   [junit4]   2> 590268 INFO  (coreCloseExecutor-4521-thread-1) [     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@34ff3e3b
   [junit4]   2> 590268 WARN  (coreCloseExecutor-4521-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 590285 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 590285 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@445a87c1: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@7cc7d4f7
   [junit4]   2> 590291 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 590291 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3743c720: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2b792270
   [junit4]   2> 590294 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 590294 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@132ee1f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@2bf4c2e5
   [junit4]   2> 590300 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 590313 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 590334 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 590337 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 591074 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 591074 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 591075 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61b8c449[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 591075 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61b8c449[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 591077 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 591078 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4742c83d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 591078 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4742c83d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 591079 WARN  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 591106 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 591113 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 591113 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 591114 INFO  (coreLoadExecutor-4533-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 591122 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 591137 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 591148 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 591152 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 591158 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 591159 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 591159 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-54-001/]
   [junit4]   2> 591161 WARN  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 591196 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 591196 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 591198 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 591198 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 591199 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=84.689453125, floorSegmentMB=2.115234375, forceMergeDeletesPctAllowed=20.38689924920731, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24188149119689228, deletesPctAllowed=28.17312435636126
   [junit4]   2> 591206 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 591207 INFO  (coreLoadExecutor-4533-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 591209 WARN  (recoveryExecutor-4537-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.u.UpdateLog Starting log replay tlog{file=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-54-001/tlog/tlog.0000000000000000001.1693084730136723456 refcount=1}  active=false starting pos=0 inSortedOrder=false
   [junit4]   2> 591210 INFO  (searcherExecutor-4535-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 591210 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 593366 INFO  (searcherExecutor-4535-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 593367 INFO  (recoveryExecutor-4537-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[2345 (1693084730136723456), 3253 (1693084730140917760), 969 (1693084730140917761), 6400 (1693084730141966336), 1929 (1693084730141966337), 6583 (1693084730141966338), 6680 (1693084730141966339), 2006 (1693084730141966340), 6269 (1693084730143014912), 4894 (1693084730143014913), ... (127 adds)],deleteByQuery=val_i_dvo:523 (-1693084730145112066),deleteByQuery=val_i_dvo:558 (-1693084730156646402),delete=[969 (-1693084730163986432), 2006 (-1693084730165035009), 2108 (-1693084730167132163), 6269 (-1693084730167132164), 6471 (-1693084730169229312), 7695 (-1693084730180763648), 113 (-1693084730192297988), 2154 (-1693084730208026627), 6583 (-1693084730208026628), 7462 (-1693084730209075200), ... (23 deletes)],deleteByQuery=val_i_dvo:877 (-1693084730170277889),deleteByQuery=val_i_dvo:813 (-1693084730181812227),deleteByQuery=val_i_dvo:104 (-1693084730194395139),deleteByQuery=val_i_dvo:662 (-1693084730214318081),deleteByQuery=val_i_dvo:757 (-1693084730235289603)} 0 2158
   [junit4]   2> 593367 WARN  (recoveryExecutor-4537-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.u.UpdateLog Log replay finished. recoveryInfo=RecoveryInfo{adds=127 deletes=16 deleteByQuery=7 errors=0 positionOfStart=0}
   [junit4]   2> 593367 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 0
   [junit4]   2> 593368 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=53 status=0 QTime=0
   [junit4]   2> 593369 ERROR (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 query failed JSON validation. error=mismatch: '52'!='53' @ response/numFound
   [junit4]   2>  expected =/response/numFound==52
   [junit4]   2>  response = {
   [junit4]   2>   "responseHeader":{
   [junit4]   2>     "status":0,
   [junit4]   2>     "QTime":0},
   [junit4]   2>   "response":{"numFound":53,"start":0,"numFoundExact":true,"docs":[
   [junit4]   2>       {
   [junit4]   2>         "id":"8036",
   [junit4]   2>         "_root_":"8036",
   [junit4]   2>         "_version_":1693084730209075201,
   [junit4]   2>         "val_i_dvo":252},
   [junit4]   2>       {
   [junit4]   2>         "id":"4559",
   [junit4]   2>         "_root_":"4559",
   [junit4]   2>         "_version_":1693084730211172356,
   [junit4]   2>         "val_i_dvo":215},
   [junit4]   2>       {
   [junit4]   2>         "id":"138",
   [junit4]   2>         "_root_":"138",
   [junit4]   2>         "_version_":1693084730206978052,
   [junit4]   2>         "val_i_dvo":275},
   [junit4]   2>       {
   [junit4]   2>         "id":"5277",
   [junit4]   2>         "_root_":"5277",
   [junit4]   2>         "_version_":1693084730210123780,
   [junit4]   2>         "val_i_dvo":216},
   [junit4]   2>       {
   [junit4]   2>         "id":"5519",
   [junit4]   2>         "_root_":"5519",
   [junit4]   2>         "_version_":1693084730213269506,
   [junit4]   2>         "val_i_dvo":496},
   [junit4]   2>       {
   [junit4]   2>         "id":"9192",
   [junit4]   2>         "_root_":"9192",
   [junit4]   2>         "_version_":1693084730167132162,
   [junit4]   2>         "val_i_dvo":308},
   [junit4]   2>       {
   [junit4]   2>         "id":"5611",
   [junit4]   2>         "_root_":"5611",
   [junit4]   2>         "_version_":1693084730181812225,
   [junit4]   2>         "val_i_dvo":427},
   [junit4]   2>       {
   [junit4]   2>         "id":"5357",
   [junit4]   2>         "_root_":"5357",
   [junit4]   2>         "_version_":1693084730211172352,
   [junit4]   2>         "val_i_dvo":776},
   [junit4]   2>       {
   [junit4]   2>         "id":"4380",
   [junit4]   2>         "_root_":"4380",
   [junit4]   2>         "_version_":1693084730192297987,
   [junit4]   2>         "val_i_dvo":351},
   [junit4]   2>       {
   [junit4]   2>         "id":"7753",
   [junit4]   2>         "_root_":"7753",
   [junit4]   2>         "_version_":1693084730235289600,
   [junit4]   2>         "val_i_dvo":385}]
   [junit4]   2>   }}
   [junit4]   2> 
   [junit4]   2>  request = q=*:*&wt=xml
   [junit4]   2> 593370 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 593370 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=614726140
   [junit4]   2> 593370 INFO  (coreCloseExecutor-4541-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3e109c78
   [junit4]   2> 593370 INFO  (coreCloseExecutor-4541-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@3e109c78
   [junit4]   2> 593370 INFO  (coreCloseExecutor-4541-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@304113f2: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3f2d6d0b
   [junit4]   2> 593383 INFO  (coreCloseExecutor-4541-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 593397 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 593398 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2cb92e05: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@68c2f4b0
   [junit4]   2> 593403 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 593403 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6087048e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2b792270
   [junit4]   2> 593406 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 593406 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@584d6e61: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@2bf4c2e5
   [junit4]   2> 593408 INFO  (TEST-TestRecovery.stressLogReplay-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###Ending stressLogReplay
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestRecovery -Dtests.method=stressLogReplay -Dtests.seed=70ADDA08C7924120 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=no -Dtests.timezone=Asia/Kamchatka -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   5.04s J0 | TestRecovery.stressLogReplay <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: '52'!='53' @ response/numFound
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70ADDA08C7924120:B50339A110045662]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1109)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1058)
   [junit4]    > 	at org.apache.solr.search.TestRecovery.stressLogReplay(TestRecovery.java:172)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 593413 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testRemoveOldLogs
   [junit4]   2> 593413 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 updateLog impl=solr.UpdateLog
   [junit4]   2> 593413 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 593418 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 593432 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 593441 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-55-001
   [junit4]   2> 593444 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 593448 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 593592 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 593592 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 593593 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2a9d2dea[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 593593 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2a9d2dea[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 593596 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 593597 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2f2e1289[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 593597 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2f2e1289[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 593598 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 593627 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 593635 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 593635 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 593637 INFO  (coreLoadExecutor-4553-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 593653 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 593672 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 593697 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 593700 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 593707 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 593708 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 593708 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001/data-dir-55-001/]
   [junit4]   2> 593709 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=84.689453125, floorSegmentMB=2.115234375, forceMergeDeletesPctAllowed=20.38689924920731, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.24188149119689228, deletesPctAllowed=28.17312435636126
   [junit4]   2> 593723 WARN  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 593759 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 593759 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 593762 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 593762 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 593763 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=41.6455078125, floorSegmentMB=0.79296875, forceMergeDeletesPctAllowed=6.94312343297497, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=43.79740501738344
   [junit4]   2> 593764 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 593764 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 593765 INFO  (coreLoadExecutor-4553-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1693084733930471424
   [junit4]   2> 593767 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 593767 INFO  (searcherExecutor-4555-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 593767 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 593769 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:* (-9223372036854775807)} 0 1
   [junit4]   2> 593784 INFO  (searcherExecutor-4555-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 593784 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 15
   [junit4]   2> 593785 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1062326888
   [junit4]   2> 593785 INFO  (coreCloseExecutor-4561-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@61bad7a1
   [junit4]   2> 593785 INFO  (coreCloseExecutor-4561-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@61bad7a1
   [junit4]   2> 593785 INFO  (coreCloseExecutor-4561-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4df4c8c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@41450dc1
   [junit4]   2> 593799 INFO  (coreCloseExecutor-4561-thread-1) [     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@58b73489
   [junit4]   2> 593799 WARN  (coreCloseExecutor-4561-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 593800 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 593800 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d44e07f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@1d2aed66
   [junit4]   2> 593806 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 593806 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@50628e1e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2b792270
   [junit4]   2> 593808 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 593808 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46a64769: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@2bf4c2e5
   [junit4]   2> 593815 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 593828 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 593840 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 593843 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 594117 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 594118 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 594118 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@72fe21c7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 594118 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@72fe21c7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 594121 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 594124 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7d6fb677[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 594124 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7d6fb677[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 594125 WARN  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 594164 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 594171 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 594171 INFO  (TEST-TestRecovery.testRemoveOldLogs-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@25a304a5
   [junit4]   2> 594172 INFO  (coreLoadExecutor-4573-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 594179 INFO  (coreLoadExecutor-4573-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core

[...truncated too long message...]

m time: 0 ms
   [junit4]   2> 657395 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=82.4794921875, floorSegmentMB=1.96875, forceMergeDeletesPctAllowed=22.653040575246607, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=27.868239275033087
   [junit4]   2> 657399 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 657400 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@426d5387
   [junit4]   2> 657400 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@426d5387
   [junit4]   2> 657400 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35ac7e5d: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@361879ce
   [junit4]   2> 657404 INFO  (searcherExecutor-5401-thread-1) [     ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 657413 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[reload1 (1693084800670236672)]} 0 0
   [junit4]   2> 657537 INFO  (searcherExecutor-5401-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 657537 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 124
   [junit4]   2> 657539 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[reload1 (1693084800801308672)]} 0 1
   [junit4]   2> 657545 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{deleteByQuery=foo_t:hownowbrowncow (-1693084800802357248)} 0 5
   [junit4]   2> 657545 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={versions=true&wt=json&indent=true}{add=[reload1 (1693084800808648704)]} 0 0
   [junit4]   2> 657545 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 657545 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2080660843
   [junit4]   2> 657546 INFO  (coreCloseExecutor-5406-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1381a0f8
   [junit4]   2> 657546 INFO  (coreCloseExecutor-5406-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1381a0f8
   [junit4]   2> 657546 INFO  (coreCloseExecutor-5406-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@56d4ecbb: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@361879ce
   [junit4]   2> 657562 INFO  (coreCloseExecutor-5406-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() .
   [junit4]   2> 657690 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 657690 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@45fc9127: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@432798f3
   [junit4]   2> 657696 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 657696 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6619b2c4: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2b792270
   [junit4]   2> 657699 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 657699 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a122161: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@2bf4c2e5
   [junit4]   2> 657701 INFO  (TEST-TestRecovery.testReload-seed#[70ADDA08C7924120]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReload
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.search.TestRecovery_70ADDA08C7924120-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {_root_=FST50, id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{_version_=DocValuesFormat(name=Lucene80), val_i_dvo=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=2013, maxMBSortInHeap=5.999945478850011, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=no, timezone=Asia/Kamchatka
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=162724152,total=529530880
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimClusterStateProvider, OverseerSolrResponseTest, CdcrBidirectionalTest, TestCustomStream, TestFoldingMultitermQuery, TestScoreJoinQPScore, UpdateRequestProcessorFactoryTest, AuditLoggerIntegrationTest, TestLuceneMatchVersion, TestAuthorizationFramework, DistribCursorPagingTest, TestDynamicFieldResource, TestChildDocTransformer, SimplePostToolTest, TestDFISimilarityFactory, JWTVerificationkeyResolverTest, TestCollapseQParserPlugin, IndexSizeTriggerTest, SuggesterWFSTTest, TestHttpShardHandlerFactory, UpdateParamsTest, CdcrRequestHandlerTest, AnalyticsMergeStrategyTest, NodeAddedTriggerTest, TestCollationField, SimpleMLTQParserTest, TestNoOpRegenerator, TestSimTriggerIntegration, TestDistribDocBasedVersion, TestExportTool, SliceStateTest, DateFieldTest, TestSnapshotCoreBackup, HLLUtilTest, PingRequestHandlerTest, TestConfigSetsAPIShareSchema, SegmentsInfoRequestHandlerTest, IndexSchemaTest, TestSolrIndexConfig, TestPostingsSolrHighlighter, BlockJoinFacetDistribTest, TestRemoteStreaming, TestOrdValues, PreAnalyzedUpdateProcessorTest, HdfsDirectoryTest, SplitShardTest, OutputWriterTest, TriggerCooldownIntegrationTest, TestInPlaceUpdatesDistrib, TestJettySolrRunner, TestLockTree, BackupIdTest, WordBreakSolrSpellCheckerTest, DistributedSuggestComponentTest, ConcurrentDeleteAndCreateCollectionTest, AutoAddReplicasPlanActionTest, TestRecovery]
   [junit4] Completed [224/934 (1!)] on J0 in 69.41s, 20 tests, 1 error <<< FAILURES!

[...truncated 53180 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1667 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1667/

2 tests failed.
FAILED:  org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader

Error Message:
Error from server at http://127.0.0.1:34289/solr: Underlying core creation failed while creating collection: pull_replica_error_handling_test_cant_connect_to_leader

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34289/solr: Underlying core creation failed while creating collection: pull_replica_error_handling_test_cant_connect_to_leader
	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481:FA9793C8E01210AB]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.TestPullReplicaErrorHandling.testCantConnectToLeader(TestPullReplicaErrorHandling.java:193)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrJmxReporterTest.testClosedCore

Error Message:
Captured an uncaught exception in thread: Thread[id=7563, name=Thread-1333, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7563, name=Thread-1333, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]
	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481:3E62598B593F671]:0)
Caused by: java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481]:0)
	at org.junit.Assert.fail(Assert.java:87)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.junit.Assert.assertNotNull(Assert.java:713)
	at org.junit.Assert.assertNotNull(Assert.java:723)
	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)




Build Log:
[...truncated 14050 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrJmxReporterTest
   [junit4]   2> 617613 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 617614 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-67-001
   [junit4]   2> 617614 WARN  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 617614 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 617616 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 617616 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 617621 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnabled
   [junit4]   2> 617621 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 617627 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 617641 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 617652 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 617666 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 617900 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 617906 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2e6491db[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 617906 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2e6491db[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 617910 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@c8e919d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 617910 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@c8e919d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 617911 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 617940 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 618049 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 618050 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 618054 INFO  (coreLoadExecutor-4344-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 618063 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 618081 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 618102 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 618109 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 618116 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 618116 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 618116 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-67-001/]
   [junit4]   2> 618117 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 618178 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 618178 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 618181 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7400661031398841]
   [junit4]   2> 618181 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 618182 INFO  (coreLoadExecutor-4344-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 618183 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 618191 INFO  (searcherExecutor-4346-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 618221 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-ilmibmlvq.SolrJmxReporterTest-jen' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 618250 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-smwnb.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 618250 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.SolrMetricReporter Reporter disabled for registry solr.core.collection1
   [junit4]   2> 618269 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 618269 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5fc7a6bc: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@251211e6
   [junit4]   2> 618283 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5ad3eb2d: rootName = SolrJmxReporterTest-xvblx, domain = SolrJmxReporterTest-, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/null
   [junit4]   2> 618283 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e690b3b: rootName = SolrJmxReporterTest-ilmibmlvq, domain = SolrJmxReporterTest-jen, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@251211e6
   [junit4]   2> 618298 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d1551a0: rootName = SolrJmxReporterTest-smwnb, domain = solr.core.collection1, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@251211e6
   [junit4]   2> 618513 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@2883bc60
   [junit4]   2> 618513 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 618513 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=84021206
   [junit4]   2> 618514 INFO  (coreCloseExecutor-4351-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2883bc60
   [junit4]   2> 618514 INFO  (coreCloseExecutor-4351-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@2883bc60
   [junit4]   2> 618515 INFO  (coreCloseExecutor-4351-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 618517 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 618517 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a47b45b: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@73ca999
   [junit4]   2> 618523 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 618523 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b509c44: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@588a28a1
   [junit4]   2> 618525 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 618525 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a6d2d1: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@379dc440
   [junit4]   2> 618527 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnabled
   [junit4]   2> 618531 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testReloadCore
   [junit4]   2> 618531 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 618536 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 618557 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 618562 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-68-001
   [junit4]   2> 618565 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 618576 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 621762 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 621763 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@47a753e0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 621763 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@47a753e0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 621770 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@f78c972[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 621770 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@f78c972[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 621772 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 621799 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 621805 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 621806 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 621891 INFO  (coreLoadExecutor-4363-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 621908 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 621983 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 621991 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 622000 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 622007 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 622007 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 622007 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-68-001/]
   [junit4]   2> 622008 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 622258 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 622258 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 622259 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7400661031398841]
   [junit4]   2> 622260 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 622260 INFO  (coreLoadExecutor-4363-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 622261 INFO  (searcherExecutor-4365-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 622261 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 622290 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-ctggew.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 622296 ERROR (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties:
   [junit4]   2>           => java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
   [junit4]   2> java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?]
   [junit4]   2> 	at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.Files.newByteChannel(Files.java:407) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.Files.newInputStream(Files.java:152) ~[?:1.8.0_281]
   [junit4]   2> 	at org.apache.solr.core.CorePropertiesLocator.buildCoreDescriptor(CorePropertiesLocator.java:187) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reloadCoreDescriptor(CoreContainer.java:1641) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1690) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1669) [java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest.testReloadCore(SolrJmxReporterTest.java:187) [test/:?]
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_281]
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_281]
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_281]
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_281]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [java/:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [java/:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [java/:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [java/:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 622307 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 622323 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 622331 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 622339 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 622345 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1
   [junit4]   2> 622379 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 622379 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-68-001/]
   [junit4]   2> 622421 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 622421 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 622423 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 622424 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 622424 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=26, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.35583171742295516]
   [junit4]   2> 622425 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 622444 INFO  (searcherExecutor-4370-thread-1) [     ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 622445 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@67370bfe
   [junit4]   2> 622445 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@67370bfe
   [junit4]   2> 622445 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@474fa932: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@136e67b2
   [junit4]   2> 622450 INFO  (searcherExecutor-4370-thread-1) [     ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 622456 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@726349b5: rootName = SolrJmxReporterTest-ctggew, domain = solr.core.collection1, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@136e67b2
   [junit4]   2> 622513 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-ctggew.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 622518 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 622518 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@768b4b5c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@136e67b2
   [junit4]   2> 622535 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a6c8a81: rootName = SolrJmxReporterTest-ctggew, domain = solr.core.collection1, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@136e67b2
   [junit4]   2> 622552 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@67370bfe
   [junit4]   2> 622552 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 622553 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1465913905
   [junit4]   2> 622553 INFO  (coreCloseExecutor-4375-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@43bb6b55
   [junit4]   2> 622553 INFO  (coreCloseExecutor-4375-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@43bb6b55
   [junit4]   2> 622554 INFO  (coreCloseExecutor-4375-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 622556 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 622556 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@466e7bdf: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@5957478f
   [junit4]   2> 622563 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 622563 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1722b554: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@588a28a1
   [junit4]   2> 622566 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 622566 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@385af526: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@379dc440
   [junit4]   2> 622569 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReloadCore
   [junit4]   2> 622572 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testClosedCore
   [junit4]   2> 622573 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 622578 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 622727 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 622733 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-69-001
   [junit4]   2> 622736 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 622743 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 623060 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 623068 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@428851cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 623068 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@428851cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 623079 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@604e028d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 623079 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@604e028d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 623080 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 623203 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 623214 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 623214 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 623244 INFO  (coreLoadExecutor-4387-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 623251 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 623276 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 623285 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 623296 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 623304 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 623304 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 623304 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-69-001/]
   [junit4]   2> 623306 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 623350 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 623350 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 623351 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7400661031398841]
   [junit4]   2> 623351 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 623352 INFO  (coreLoadExecutor-4387-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 623353 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 623353 INFO  (searcherExecutor-4389-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 623381 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-fibagn.SolrJmxReporterTest-xyxknyw' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 623921 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 623921 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7da16e15: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2c76fa54
   [junit4]   2> 623938 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@225003ef: rootName = SolrJmxReporterTest-fibagn, domain = SolrJmxReporterTest-xyxknyw, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2c76fa54
   [junit4]   2> 623965 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@41d1a3f4
   [junit4]   2> 623965 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@41d1a3f4
   [junit4]   2> 623971 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> бер. 01, 2021 5:47:02 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-1333,5,TGRP-SolrJmxReporterTest]
   [junit4]   2> java.lang.AssertionError
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481]:0)
   [junit4]   2> 	at org.junit.Assert.fail(Assert.java:87)
   [junit4]   2> 	at org.junit.Assert.assertTrue(Assert.java:42)
   [junit4]   2> 	at org.junit.Assert.assertNotNull(Assert.java:713)
   [junit4]   2> 	at org.junit.Assert.assertNotNull(Assert.java:723)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)
   [junit4]   2> 
   [junit4]   2> 625998 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 625998 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@41d1a3f4
   [junit4]   2> 625998 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 625998 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=86126429
   [junit4]   2> 626008 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 626008 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76d7625b: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@19cef852
   [junit4]   2> 626014 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 626014 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3314cabe: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@588a28a1
   [junit4]   2> 626017 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 626017 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1ed77a0d: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@379dc440
   [junit4]   2> 626044 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testClosedCore
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrJmxReporterTest -Dtests.method=testClosedCore -Dtests.seed=749BF3B8950A9481 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=uk -Dtests.timezone=Cuba -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   3.48s J3 | SolrJmxReporterTest.testClosedCore <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7563, name=Thread-1333, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481:3E62598B593F671]:0)
   [junit4]    > Caused by: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([749BF3B8950A9481]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)
   [junit4]   2> 626049 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testReportMetrics
   [junit4]   2> 626049 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 626054 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 626078 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 626084 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-70-001
   [junit4]   2> 626087 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 626094 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 627115 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 627116 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@28352d3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 627116 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@28352d3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 627122 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4fa90e9a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 627122 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4fa90e9a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 627124 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 627152 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 627159 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 627160 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 627161 INFO  (coreLoadExecutor-4405-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 627175 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 627210 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 627218 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 627234 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 627248 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 627248 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@68503fb5
   [junit4]   2> 627248 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_749BF3B8950A9481-001/data-dir-70-001/]
   [junit4]   2> 627249 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 627437 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 627437 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 627437 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7400661031398841]
   [junit4]   2> 627438 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 627439 INFO  (coreLoadExecutor-4405-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 627440 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 627448 INFO  (searcherExecutor-4407-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 627468 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-pljct.SolrJmxReporterTest-' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d265b1d
   [junit4]   2> 627482 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 627482 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11d5aa86: rootName = SolrJmxReporterTest-pljct, domain = SolrJmxReporterTest-, service url = null, agent id = localhost_1614638816000] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2e081ae1
   [junit4]   2> 627497 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@351070e3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2e081ae1
   [junit4]   2> 627512 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@4d163517
   [junit4]   2> 627512 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 627512 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=613601431
   [junit4]   2> 627513 INFO  (coreCloseExecutor-4412-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4d163517
   [junit4]   2> 627513 INFO  (coreCloseExecutor-4412-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@4d163517
   [junit4]   2> 627514 INFO  (coreCloseExecutor-4412-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 627514 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 627514 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ec99907: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@79cb7955
   [junit4]   2> 627520 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 627520 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@753ed569: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@588a28a1
   [junit4]   2> 627528 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 627528 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@37286fd4: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@379dc440
   [junit4]   2> 627530 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[749BF3B8950A9481]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReportMetrics
   [junit4]   2> 627531 INFO  (SUITE-SolrJmxReporterTest-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=687, maxMBSortInHeap=7.836978257578284, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=uk, timezone=Cuba
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=167759784,total=530055168
   [junit4]   2> NOTE: All tests run in this JVM: [SolrLogAuditLoggerPluginTest, SchemaApiFailureTest, TestNRTOpen, TestIndexingPerformance, TestDocTermOrdsUninvertLimit, TestClassicSimilarityFactory, TestHighFrequencyDictionaryFactory, TestPayloadScoreQParserPlugin, RankQueryTest, TestDynamicURP, BasicAuthOnSingleNodeTest, SmileWriterTest, DistributedFacetPivotLongTailTest, IndexSizeTriggerSizeEstimationTest, TestTrie, TestJsonFacetRefinement, TestTermsQParserPlugin, SortSpecParsingTest, UniqFieldsUpdateProcessorFactoryTest, MissingSegmentRecoveryTest, CdcrReplicationHandlerTest, TestDynamicFieldCollectionResource, TriLevelCompositeIdRoutingTest, SharedFSAutoReplicaFailoverTest, TestHdfsBackupRestoreCore, TestManagedStopFilterFactory, AtomicUpdateProcessorFactoryTest, TestSSLRandomization, RuleEngineTest, TestSubQueryTransformer, ScriptEngineTest, TestStressIncrementalBackup, TestSolrCoreParser, MetricUtilsTest, TestInPlaceUpdateWithRouteField, MBeansHandlerTest, SolrTestCaseJ4DeleteCoreTest, TestSolrJacksonAnnotation, TestFieldCacheSortRandom, AnalysisErrorHandlingTest, TestSolrQueryResponse, PreAnalyzedFieldTest, BasicDistributedZkTest, SpellCheckCollatorTest, TestBlendedInfixSuggestions, TestStressCloudBlindAtomicUpdates, TemplateUpdateProcessorTest, CloudExitableDirectoryReaderTest, TestExtendedDismaxParser, CloudReplicaSourceTest, TestScoreJoinQPNoScore, DocValuesMultiTest, CSVRequestHandlerTest, TestLRUStatsCache, TestShardHandlerFactory, TestObjectReleaseTracker, TestPrepRecovery, BlobRepositoryCloudTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSimScenario, TestBlobHandler, TimeRoutedAliasUpdateProcessorTest, TestReplicationHandlerDiskOverFlow, SimpleFacetsTest, TestRandomFlRTGCloud, MergeStrategyTest, RAMDirectoryFactoryTest, TestWriterPerf, TestPushWriter, DeleteLastCustomShardedReplicaTest, TestRandomFaceting, ZkControllerTest, TestSort, CrossCollectionJoinQueryTest, SuggesterTest, SolrJmxReporterTest]
   [junit4] Completed [245/934 (1!)] on J3 in 10.08s, 4 tests, 1 error <<< FAILURES!

[...truncated 389 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4]   2> 777155 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 777155 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_749BF3B8950A9481-001/data-dir-70-001
   [junit4]   2> 777155 WARN  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 777155 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 777157 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 777157 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 777157 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_749BF3B8950A9481-001/tempDir-001
   [junit4]   2> 777158 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 777163 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 777163 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 777164 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 777263 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 45479
   [junit4]   2> 777263 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:45479
   [junit4]   2> 777263 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45479
   [junit4]   2> 777263 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45479
   [junit4]   2> 777264 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777266 INFO  (zkConnectionManagerCallback-9255-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 777266 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 777279 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777283 INFO  (zkConnectionManagerCallback-9257-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 777283 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 777287 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777291 INFO  (zkConnectionManagerCallback-9259-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 777291 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 777393 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 777393 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 777393 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 777394 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 777394 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 777394 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 777395 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 777396 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 777396 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 777396 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 777396 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29b34228{/solr,null,AVAILABLE}
   [junit4]   2> 777397 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 777397 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 777397 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 777399 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e11171c{/solr,null,AVAILABLE}
   [junit4]   2> 777443 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 777443 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 777443 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 777471 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@67f234a0{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:38867}
   [junit4]   2> 777471 INFO  (jetty-launcher-9260-thread-1) [     ] o.e.j.s.Server Started @777598ms
   [junit4]   2> 777471 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45479/solr, hostPort=38867}
   [junit4]   2> 777471 ERROR (jetty-launcher-9260-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 777471 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 777471 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 777472 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 777472 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 777472 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-01T22:49:35.931Z
   [junit4]   2> 777474 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62cbcfd6{/solr,null,AVAILABLE}
   [junit4]   2> 777477 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 777477 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 777477 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 777479 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6367064b{/solr,null,AVAILABLE}
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4911cc57{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:34215}
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.e.j.s.Server Started @777606ms
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45479/solr, hostPort=34215}
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5968c4e5{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:36221}
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.e.j.s.Server Started @777606ms
   [junit4]   2> 777480 ERROR (jetty-launcher-9260-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45479/solr, hostPort=36221}
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-01T22:49:35.939Z
   [junit4]   2> 777480 ERROR (jetty-launcher-9260-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 777480 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-01T22:49:35.939Z
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@580c57d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:34253}
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.e.j.s.Server Started @777607ms
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45479/solr, hostPort=34253}
   [junit4]   2> 777481 ERROR (jetty-launcher-9260-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-03-01T22:49:35.940Z
   [junit4]   2> 777481 INFO  (zkConnectionManagerCallback-9262-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 777481 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 777482 INFO  (jetty-launcher-9260-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777482 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 777483 INFO  (jetty-launcher-9260-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 777486 INFO  (jetty-launcher-9260-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 777487 INFO  (zkConnectionManagerCallback-9264-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 777487 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 777487 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 777490 INFO  (jetty-launcher-9260-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4

[...truncated too long message...]

ng
   [junit4]   2> 900541 INFO  (jetty-closer-9555-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@4e8df837{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 900541 INFO  (jetty-closer-9555-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3d36216a{/solr,null,STOPPED}
   [junit4]   2> 900541 INFO  (jetty-closer-9555-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 900542 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 900543 WARN  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker-SendThread(127.0.0.1:45479)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a6e8afc30000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a6e8afc30000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a6e8afc30000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 900749 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/aliases.json
   [junit4]   2> 	13	/solr/configs/conf
   [junit4]   2> 	12	/solr/security.json
   [junit4]   2> 	9	/solr/collections/pull_replica_error_handling_test_close_hooks_deleted_on_reconnect/terms/shard1
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	8	/solr/packages.json
   [junit4]   2> 	8	/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/terms/shard1
   [junit4]   2> 	7	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard2
   [junit4]   2> 	6	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/terms/shard1
   [junit4]   2> 	6	/solr/collections/pull_replica_error_handling_test_close_hooks_deleted_on_reconnect/state.json
   [junit4]   2> 	4	/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/terms/shard1
   [junit4]   2> 	4	/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
   [junit4]   2> 	4	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
   [junit4]   2> 	2	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	102	/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
   [junit4]   2> 	52	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
   [junit4]   2> 	44	/solr/collections/pull_replica_error_handling_test_close_hooks_deleted_on_reconnect/state.json
   [junit4]   2> 	38	/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
   [junit4]   2> 	13	/solr/clusterstate.json
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/overseer_elect/election/73085537279475730-127.0.0.1:34149_solr-n_0000000004
   [junit4]   2> 	3	/solr/overseer_elect/election/73085537279475739-127.0.0.1:44855_solr-n_0000000007
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	116	/solr/overseer/queue
   [junit4]   2> 	100	/solr/live_nodes
   [junit4]   2> 	96	/solr/collections/pull_replica_error_handling_test_cant_connect_to_leader/state.json
   [junit4]   2> 	53	/solr/collections
   [junit4]   2> 	29	/solr/overseer/collection-queue-work
   [junit4]   2> 	17	/solr/collections/pull_replica_error_handling_test_cant_connect_to_pull_replica/state.json
   [junit4]   2> 	16	/solr/collections/pull_replica_error_handling_test_close_hooks_deleted_on_reconnect/state.json
   [junit4]   2> 	14	/solr/collections/pull_replica_error_handling_test_pull_replica_disconnects_from_zoo_keeper/state.json
   [junit4]   2> 	5	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	5	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 900752 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:45479
   [junit4]   2> 900752 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45479
   [junit4]   2> 900752 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[749BF3B8950A9481]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45479
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplicaErrorHandling_749BF3B8950A9481-001
   [junit4]   2> Mar 01, 2021 10:51:39 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFieldsData(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=11, maxDocsPerChunk=371, blockShift=17), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=11, blockSize=17)), sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=is-IS, timezone=Asia/Barnaul
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=60417568,total=523763712
   [junit4]   2> NOTE: All tests run in this JVM: [TestMergePolicyConfig, MetricTriggerIntegrationTest, CustomTermsComponentTest, TestCSVResponseWriter, TestSolrJ, TestRebalanceLeaders, ExplicitHLLTest, DirectoryFactoriesTest, NodeLostTriggerIntegrationTest, TestSafeXMLParsing, HdfsBasicDistributedZkTest, HdfsRecoverLeaseTest, TestSchemaManager, TestUseDocValuesAsStored, SolrCoreMetricManagerTest, TestBackupRepositoryFactory, TestRawTransformer, TestReplicationHandler, SolrGraphiteReporterTest, TestFieldSortValues, ProtectedTermFilterFactoryTest, TestNamedUpdateProcessors, TriggerEventQueueTest, TestTestInjection, HdfsLockFactoryTest, NumberUtilsTest, TestSolrXml, TestUpdate, SearchRateTriggerTest, CloneFieldUpdateProcessorFactoryTest, LoggingHandlerTest, ReindexCollectionTest, ConnectionReuseTest, QueryParsingTest, TestDocSet, DeleteReplicaTest, ShardRoutingTest, TestMinHashQParser, TestLogWatcher, TestFacetMethods, TestMacros, TestMiniSolrCloudClusterSSL, CustomCollectionTest, ZookeeperStatusHandlerTest, TestConfigOverlay, SolrLogPostToolTest, HttpPartitionOnCommitTest, ZkDynamicConfigTest, TestFastOutputStream, OverseerSolrResponseUnsafeSerializationTest, XMLAtomicUpdateMultivalueTest, DateRangeFieldTest, TestInPlaceUpdatesRequiredField, RequestLoggingTest, TestLFUCache, TestEmbeddedSolrServerAdminHandler, NestedShardedAtomicUpdateTest, TestSchemaNameResource, MoveReplicaHDFSTest, CdcrVersionReplicationTest, TestBulkSchemaConcurrent, BJQFilterAccessibleTest, TestStressLucene, AutoScalingHandlerTest, TestPullReplicaErrorHandling]
   [junit4] Completed [358/934 (2!)] on J1 in 124.01s, 4 tests, 1 error <<< FAILURES!

[...truncated 52727 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1666 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1666/

1 tests failed.
FAILED:  org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([7EC258DCFCCF4DB3:F802BFE958292EDA]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
</response>

	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
	... 45 more




Build Log:
[...truncated 15890 lines...]
   [junit4] Suite: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 2128105 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 2128106 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_7EC258DCFCCF4DB3-001/data-dir-233-001
   [junit4]   2> 2128106 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=29 numCloses=29
   [junit4]   2> 2128106 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2128107 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2128108 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2128108 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2128113 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2128130 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2128137 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2128147 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2129513 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2129513 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 2129514 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5d40b6ec[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2129514 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5d40b6ec[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2129517 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 2129517 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@315de812[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2129517 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@315de812[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2129519 WARN  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 2129545 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69a3bdfe
   [junit4]   2> 2129551 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69a3bdfe
   [junit4]   2> 2129552 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69a3bdfe
   [junit4]   2> 2129553 INFO  (coreLoadExecutor-22745-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2129563 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2129580 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2129587 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2129589 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2129589 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2129589 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69a3bdfe
   [junit4]   2> 2129589 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_7EC258DCFCCF4DB3-001/data-dir-233-001/]
   [junit4]   2> 2129590 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=86.439453125, floorSegmentMB=1.03125, forceMergeDeletesPctAllowed=11.23309037473604, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=25.312428174252272
   [junit4]   2> 2129626 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2129626 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2129627 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5350789451587327]
   [junit4]   2> 2129627 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 2129628 INFO  (coreLoadExecutor-22745-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2129628 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2129629 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129633 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumFieldTypeWithoutDocValues
   [junit4]   2> 2129634 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumFieldTypeWithoutDocValues
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumFieldTypeWithoutDocValues
   [junit4]    > Assumption #1: Only testing EnumFieldType without docValues.
   [junit4]   2> 2129637 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSchema
   [junit4]   2> 2129638 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSchema
   [junit4]   2> 2129642 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedSetQuery
   [junit4]   2> 2129643 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2129646 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumRangeSearch
   [junit4]   2> 2129647 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumRangeSearch
   [junit4] IGNOR/A 0.00s J2 | EnumFieldTest.testMultivaluedEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of range searching over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2129651 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumIndexing
   [junit4]   2> 2129651 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129651 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129651 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129652 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: blabla
   [junit4]   2> 2129652 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129652 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: 145
   [junit4]   2> 2129652 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129652 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: -4
   [junit4]   2> 2129653 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumIndexing
   [junit4]   2> 2129656 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumSearch
   [junit4]   2> 2129657 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129657 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129657 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2129659 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2129659 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2129659 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2129659 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2129660 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2129660 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2129664 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129664 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2129665 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:bla&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129665 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:7&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129665 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:"-3"&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129666 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumSearch
   [junit4]   2> 2129670 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumRangeSearch
   [junit4]   2> 2129671 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2129674 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSort
   [junit4]   2> 2129675 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSort
   [junit4] IGNOR/A 0.00s J2 | EnumFieldTest.testEnumSort
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2129679 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumIndexing
   [junit4]   2> 2129679 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129679 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129679 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129680 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: blabla
   [junit4]   2> 2129680 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129680 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: 145
   [junit4]   2> 2129680 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2129680 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: -4
   [junit4]   2> 2129681 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumIndexing
   [junit4]   2> 2129685 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testKnownIntegerEnumIndexing
   [junit4]   2> 2129685 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129685 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129685 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2129685 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2129689 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129689 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2129689 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2129691 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testKnownIntegerEnumIndexing
   [junit4]   2> 2129698 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2129698 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129698 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129699 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2129699 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2129702 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129702 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2129703 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity_mv&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2129704 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2129707 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumSearch
   [junit4]   2> 2129707 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129707 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129708 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2129708 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2129708 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2129708 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2129708 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2129709 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2129709 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2129712 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129712 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2129713 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:bla&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129713 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:7&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129730 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:"-3"&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129731 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumSearch
   [junit4]   2> 2129743 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testFacetEnumSearch
   [junit4]   2> 2129743 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2129743 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2129744 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2129744 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2129744 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2129744 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2129745 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2129745 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5]} 0 0
   [junit4]   2> 2129748 INFO  (searcherExecutor-22747-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2129750 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2129750 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2129750 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 2129751 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]   2> 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2129751 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testFacetEnumSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=EnumFieldTest -Dtests.method=testFacetEnumSearch -Dtests.seed=7EC258DCFCCF4DB3 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-PA -Dtests.timezone=Europe/Istanbul -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.03s J2 | EnumFieldTest.testFacetEnumSearch <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7EC258DCFCCF4DB3:F802BFE958292EDA]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]    > 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]    > </response>
   [junit4]    > 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]    > 	... 45 more
   [junit4]   2> 2129767 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testSetQuery
   [junit4]   2> 2129768 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2129771 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumSort
   [junit4]   2> 2129772 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[7EC258DCFCCF4DB3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumSort
   [junit4] IGNOR/A 0.00s J2 | EnumFieldTest.testMultivaluedEnumSort
   [junit4]    > Assumption #1: Skipping testing of sorting over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2129773 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2129773 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1541822838
   [junit4]   2> 2129775 INFO  (coreCloseExecutor-22752-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3dd21bcd
   [junit4]   2> 2129775 INFO  (coreCloseExecutor-22752-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@3dd21bcd
   [junit4]   2> 2129775 INFO  (coreCloseExecutor-22752-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76926ac3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@5a82d744
   [junit4]   2> 2129785 INFO  (coreCloseExecutor-22752-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 2129798 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 2129798 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@514dc264: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@56a87d79
   [junit4]   2> 2129803 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 2129803 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b6f0da8: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1e555149
   [junit4]   2> 2129805 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 2129805 INFO  (SUITE-EnumFieldTest-seed#[7EC258DCFCCF4DB3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2a663be2: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@729db7dd
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_7EC258DCFCCF4DB3-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {severity_missingFirst=PostingsFormat(name=MockRandom), severity_missingLast=PostingsFormat(name=LuceneVarGapFixedInterval), id=BlockTreeOrds(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1897, maxMBSortInHeap=7.509004066211152, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=es-PA, timezone=Europe/Istanbul
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=157826280,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [TestSQLHandler, BigEndianAscendingWordDeserializerTest, TestFaceting, TestReRankQParserPlugin, CurrencyRangeFacetCloudTest, SuggestComponentTest, MaxScoreCollectorTest, RemoteQueryErrorTest, QueryResultKeyTest, TestCloudRecovery, QueryElevationComponentTest, CdcrOpsAndBoundariesTest, DistanceFunctionTest, TestSurroundQueryParser, ExternalFileFieldSortTest, CachingDirectoryFactoryTest, TestCollectionsAPIViaSolrCloudCluster, DocValuesMissingTest, SolrJmxReporterCloudTest, TestWordDelimiterFilterFactory, IndexBasedSpellCheckerTest, ForceLeaderTest, RankQParserPluginTest, DistributedFacetPivotWhiteBoxTest, TestTlogReplayVsRecovery, TestIBSimilarityFactory, TestExplainDocTransformer, TestLRUCache, SolrMetricManagerTest, TestSolrCLIRunExample, TestStressRecovery, SolrInfoBeanTest, ImplicitSnitchTest, XmlInterpolationTest, TestFuzzyAnalyzedSuggestions, AddSchemaFieldsUpdateProcessorFactoryTest, JSONWriterTest, MoveReplicaTest, TestTolerantSearch, TestReload, ZkShardTermsTest, TestPKIAuthenticationPlugin, TestUtilizeNode, BadComponentTest, TestBlockCollapse, TestHdfsUpdateLog, IndexSizeTriggerMixedBoundsTest, JvmMetricsTest, StatelessScriptUpdateProcessorFactoryTest, AuthToolTest, FieldMutatingUpdateProcessorTest, DistanceUnitsTest, HdfsChaosMonkeyNothingIsSafeTest, BasicDistributedZk2Test, TestBadConfig, TestXIncludeConfig, AlternateDirectoryTest, TestClusterStateMutator, BlockDirectoryTest, JWTAuthPluginTest, ComputePlanActionTest, SSLMigrationTest, MigrateRouteKeyTest, TestTrackingShardHandlerFactory, ShardsWhitelistTest, TestSolrCachePerf, TestPartialUpdateDeduplication, DistribJoinFromCollectionTest, HdfsRecoveryZkTest, PreAnalyzedFieldManagedSchemaCloudTest, TestJsonRequest, HealthCheckHandlerTest, TestDownShardTolerantSearch, TestSolrDeletionPolicy1, TestInitParams, SolrIndexSearcherTest, BadCopyFieldTest, SolrCloudExampleTest, TestSchemaResource, FullHLLTest, TestExactStatsCache, TestUseDocValuesAsStored2, ShardTermsTest, DebugComponentTest, SpatialHeatmapFacetsTest, TransactionLogTest, RestartWhileUpdatingTest, SuggesterTSTTest, V2ApiIntegrationTest, BackupRestoreApiErrorConditionsTest, AdminHandlersProxyTest, TestSolrCloudWithHadoopAuthPlugin, TestSimpleQParserPlugin, TestLegacyFieldCache, TriggerIntegrationTest, SparseHLLTest, DefaultValueUpdateProcessorTest, SystemCollectionCompatTest, OverseerModifyCollectionTest, TestSimDistribStateManager, DeleteInactiveReplicaTest, DirectoryFactoryTest, TestFunctionQuery, RootFieldTest, TestSimGenericDistributedQueue, TestSizeLimitedDistributedMap, TestUtils, ThreadDumpHandlerTest, TestFilteredDocIdSet, HighlighterTest, TestPHPSerializedResponseWriter, CollectionsAPIDistributedZkTest, HdfsTlogReplayBufferedWhileIndexingTest, ConcurrentCreateRoutedAliasTest, TestConfigSetsAPI, AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, CursorPagingTest, DistributedIntervalFacetingTest, TestDocumentBuilder, TestGroupingSearch, TestJoin, PathHierarchyTokenizerFactoryTest, TestCharFilters, TestLuceneMatchVersion, TestReversedWildcardFilterFactory, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AliasIntegrationTest, ChaosMonkeySafeLeaderTest, ClusterStateMockUtilTest, ClusterStateTest, ClusterStateUpdateTest, DeleteNodeTest, DeleteShardTest, DistributedVersionInfoTest, HttpPartitionOnCommitTest, LeaderElectionContextKeyTest, LeaderElectionIntegrationTest, LeaderFailoverAfterPartitionTest, LegacyCloudClusterPropTest, NodeMutatorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerSolrResponseTest, OverseerSolrResponseUnsafeSerializationTest, OverseerStatusTest, OverseerTest, RecoveryAfterSoftCommitTest, TestCloudConsistency, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestHashPartitioner, TestOnReconnectListenerSupport, TestRandomFlRTGCloud, TestSolrCloudWithDelegationTokens, TestTolerantUpdateProcessorCloud, ZkFailoverTest, ConcurrentDeleteAndCreateCollectionTest, HdfsCloudIncrementalBackupTest, AutoScalingHandlerTest, MetricTriggerTest, NodeLostTriggerTest, SystemLogListenerTest, TriggerEventQueueTest, TestSimComputePlanAction, TestSimExecutePlanAction, TestSimExtremeIndexing, TestSimPolicyCloud, TestSimScenario, TestSimUtils, TestSnapshotCloudManager, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsNNFailoverTest, SolrCoreTest, TestCorePropertiesReload, TestDynamicLoadingUrl, TestDistribPackageStore, TestContainerPlugin, TestSolrConfigHandlerConcurrent, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, LoggingHandlerTest, LukeRequestHandlerTest, MetricsHandlerTest, PropertiesRequestHandlerTest, SecurityConfHandlerTest, TestApiFramework, TestCollectionAPIs, TestConfigsApi, TestCoreAdminApis, DistributedFacetPivotLargeTest, DistributedFacetPivotLongTailTest, DistributedSpellCheckComponentTest, EmbeddedSolrNoSerializeTest, Tagger2Test, TestPostingsSolrHighlighter, TestUnifiedSolrHighlighterWithoutStoredId, TestSlowCompositeReaderWrapper, UninvertDocValuesMergePolicyTest, TestLegacyFieldReuse, TestLegacyNumericUtils, TestNumericRangeQuery32, TestNumericRangeQuery64, TestNumericTokenStream, TestLogWatcher, MetricsDisabledCloudTest, SolrShardReporterTest, TestManagedResource, TestManagedResourceStorage, TestFieldTypeResource, TestSchemaVersionResource, TestUniqueKeyFieldResource, TestManagedSynonymFilterFactory, CurrencyFieldTypeTest, EnumFieldTest]
   [junit4] Completed [765/934 (1!)] on J2 in 1.96s, 15 tests, 1 error, 7 skipped <<< FAILURES!

[...truncated 51269 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1665 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1665/

All tests passed

Build Log:
[...truncated 67166 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1664 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1664/

1 tests failed.
FAILED:  org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([711434388EBBCAC3:F7D4D30D2A5DA9AA]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
</response>

	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
	... 45 more




Build Log:
[...truncated 15837 lines...]
   [junit4] Suite: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 2098191 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 2098191 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_711434388EBBCAC3-001/data-dir-184-001
   [junit4]   2> 2098191 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2098192 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2098192 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2098192 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 2098195 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2098207 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2098213 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2098215 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2098999 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2099000 WARN  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2db8c0b9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2099000 WARN  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2db8c0b9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2099002 WARN  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@14023271[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2099002 WARN  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@14023271[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2099004 WARN  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 2099044 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f763aec
   [junit4]   2> 2099051 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f763aec
   [junit4]   2> 2099051 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f763aec
   [junit4]   2> 2099056 INFO  (coreLoadExecutor-23505-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2099063 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2099080 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 2099086 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=tiny
   [junit4]   2> 2099089 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
   [junit4]   2> 2099089 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2099089 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f763aec
   [junit4]   2> 2099089 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_711434388EBBCAC3-001/data-dir-184-001/]
   [junit4]   2> 2099090 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44174603753815844]
   [junit4]   2> 2099127 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2099127 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2099128 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5621258463808473]
   [junit4]   2> 2099129 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 2099129 INFO  (coreLoadExecutor-23505-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2099130 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 2099265 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099278 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumIndexing
   [junit4]   2> 2099278 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099278 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099279 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099279 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: blabla
   [junit4]   2> 2099279 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099283 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: 145
   [junit4]   2> 2099283 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099284 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity, value: -4
   [junit4]   2> 2099284 INFO  (TEST-EnumFieldTest.testBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumIndexing
   [junit4]   2> 2099289 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumIndexing
   [junit4]   2> 2099289 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099289 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099289 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099290 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: blabla
   [junit4]   2> 2099290 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099290 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: 145
   [junit4]   2> 2099290 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{} 0 0
   [junit4]   2> 2099291 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.h.RequestHandlerBase Ignoring exception matching Unknown value for enum field: severity_mv, value: -4
   [junit4]   2> 2099293 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumIndexing
   [junit4]   2> 2099298 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumRangeSearch
   [junit4]   2> 2099299 INFO  (TEST-EnumFieldTest.testEnumRangeSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumRangeSearch
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2099303 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumFieldTypeWithoutDocValues
   [junit4]   2> 2099304 INFO  (TEST-EnumFieldTest.testEnumFieldTypeWithoutDocValues-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumFieldTypeWithoutDocValues
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumFieldTypeWithoutDocValues
   [junit4]    > Assumption #1: Only testing EnumFieldType without docValues.
   [junit4]   2> 2099308 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedSetQuery
   [junit4]   2> 2099309 INFO  (TEST-EnumFieldTest.testMultivaluedSetQuery-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2099322 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testFacetEnumSearch
   [junit4]   2> 2099322 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099322 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099323 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2099326 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2099326 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2099326 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2099327 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2099327 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5]} 0 0
   [junit4]   2> 2099332 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099332 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 5
   [junit4]   2> 2099333 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099333 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 2099333 ERROR (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml:java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]   2> 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2099334 INFO  (TEST-EnumFieldTest.testFacetEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testFacetEnumSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=EnumFieldTest -Dtests.method=testFacetEnumSearch -Dtests.seed=711434388EBBCAC3 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=uk -Dtests.timezone=BET -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.02s J2 | EnumFieldTest.testFacetEnumSearch <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([711434388EBBCAC3:F7D4D30D2A5DA9AA]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1023)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:983)
   [junit4]    > 	at org.apache.solr.schema.EnumFieldTest.testFacetEnumSearch(EnumFieldTest.java:594)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//*[@name='facets']/int/text()=6
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">severity:*</str><str name="json.facet">{ severity : { type : terms, field : severity, missing : true, exists : true, allBuckets : true, method : enum }}</str><str name="fl">severity</str><str name="wt">xml</str></lst></lst><result name="response" numFound="0" start="0" numFoundExact="true"></result><lst name="facets"><int name="count">0</int></lst>
   [junit4]    > </response>
   [junit4]    > 	request was:q=severity:*&json.facet={+severity+:+{+type+:+terms,+field+:+severity,+missing+:+true,+exists+:+true,+allBuckets+:+true,+method+:+enum+}}&fl=severity&wt=xml
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:1016)
   [junit4]    > 	... 45 more
   [junit4]   2> 2099340 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testKnownIntegerEnumIndexing
   [junit4]   2> 2099340 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099340 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099340 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2099341 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2099344 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099344 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2099345 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2099346 INFO  (TEST-EnumFieldTest.testKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testKnownIntegerEnumIndexing
   [junit4]   2> 2099350 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumSort
   [junit4]   2> 2099351 INFO  (TEST-EnumFieldTest.testMultivaluedEnumSort-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumSort
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testMultivaluedEnumSort
   [junit4]    > Assumption #1: Skipping testing of sorting over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2099355 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSchema
   [junit4]   2> 2099356 INFO  (TEST-EnumFieldTest.testEnumSchema-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSchema
   [junit4]   2> 2099360 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedEnumRangeSearch
   [junit4]   2> 2099361 INFO  (TEST-EnumFieldTest.testMultivaluedEnumRangeSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedEnumRangeSearch
   [junit4] IGNOR/A 0.00s J2 | EnumFieldTest.testMultivaluedEnumRangeSearch
   [junit4]    > Assumption #1: Skipping testing of range searching over multivalued EnumField - see SOLR-11193
   [junit4]   2> 2099365 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2099365 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099365 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099366 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2099366 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2099370 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099370 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2099370 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=id,severity_mv&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 2099371 INFO  (TEST-EnumFieldTest.testMultivaluedKnownIntegerEnumIndexing-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedKnownIntegerEnumIndexing
   [junit4]   2> 2099375 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBogusEnumSearch
   [junit4]   2> 2099376 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099376 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099376 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2099376 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2099377 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2099377 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2099377 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2099377 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2099378 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2099382 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099382 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 4
   [junit4]   2> 2099382 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:bla&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099383 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:7&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099383 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity:"-3"&fl=severity&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099384 INFO  (TEST-EnumFieldTest.testBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBogusEnumSearch
   [junit4]   2> 2099389 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testMultivaluedBogusEnumSearch
   [junit4]   2> 2099389 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.DirectUpdateHandler2 [collection1]  REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 2099389 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 2099389 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[0]} 0 0
   [junit4]   2> 2099389 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 0
   [junit4]   2> 2099390 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 0
   [junit4]   2> 2099390 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 0
   [junit4]   2> 2099390 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 0
   [junit4]   2> 2099390 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 0
   [junit4]   2> 2099391 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[9]} 0 0
   [junit4]   2> 2099394 INFO  (searcherExecutor-23507-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2099394 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 3
   [junit4]   2> 2099395 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:bla&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099395 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:7&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099395 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=severity_mv:"-3"&fl=severity_mv&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 2099396 INFO  (TEST-EnumFieldTest.testMultivaluedBogusEnumSearch-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedBogusEnumSearch
   [junit4]   2> 2099401 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnumSort
   [junit4]   2> 2099402 INFO  (TEST-EnumFieldTest.testEnumSort-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnumSort
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testEnumSort
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2099406 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testSetQuery
   [junit4]   2> 2099407 INFO  (TEST-EnumFieldTest.testSetQuery-seed#[711434388EBBCAC3]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testSetQuery
   [junit4] IGNOR/A 0.01s J2 | EnumFieldTest.testSetQuery
   [junit4]    > Assumption #1: Skipping testing of unindexed EnumField without docValues, which is unsupported.
   [junit4]   2> 2099407 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 2099407 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1011922895
   [junit4]   2> 2099408 INFO  (coreCloseExecutor-23512-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5759333b
   [junit4]   2> 2099408 INFO  (coreCloseExecutor-23512-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@5759333b
   [junit4]   2> 2099408 INFO  (coreCloseExecutor-23512-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@70588806: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@7d884495
   [junit4]   2> 2099671 INFO  (coreCloseExecutor-23512-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 2099676 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 2099676 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3f492225: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@4396b0af
   [junit4]   2> 2099681 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 2099681 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18e0628d: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@413ff22c
   [junit4]   2> 2099684 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 2099684 INFO  (SUITE-EnumFieldTest-seed#[711434388EBBCAC3]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d408ed9: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@470f8db5
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.schema.EnumFieldTest_711434388EBBCAC3-001
   [junit4]   2> NOTE: test params are: codec=Lucene87, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=uk, timezone=BET
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=293681096,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSearcherTest, DeleteShardTest, TestPayloadCheckQParserPlugin, BlockDirectoryTest, AlternateDirectoryTest, MetricTriggerTest, TestManagedResource, TestSimpleQParserPlugin, TestApiFramework, SolrMetricManagerTest, TestUtilizeNode, IndexSizeTriggerMixedBoundsTest, HdfsChaosMonkeyNothingIsSafeTest, TestRetrieveFieldsOptimizer, CleanupOldIndexTest, DistanceUnitsTest, TestNumericRangeQuery32, TestQueryingOnDownCollection, RootFieldTest, TestFilteredDocIdSet, PKIAuthenticationIntegrationTest, TestUnInvertedFieldException, TestQueryUtils, RankQParserPluginTest, ClassificationUpdateProcessorFactoryTest, TestCloudInspectUtil, LeaderVoteWaitTimeoutTest, DistanceFunctionTest, TestReplicationHandlerBackup, TestRequestForwarding, ForceLeaderTest, XmlInterpolationTest, OrderedExecutorTest, SpellingQueryConverterTest, TestCloudRecovery, QueryResultKeyTest, TestFieldResource, TestReRankQParserPlugin, DirectUpdateHandlerTest, MaxScoreCollectorTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestUniqueKeyFieldResource, CollectionsAPIDistributedZkTest, IndexBasedSpellCheckerTest, TestBlockCollapse, TestBooleanSimilarityFactory, TestFuzzyAnalyzedSuggestions, TlogReplayBufferedWhileIndexingTest, DefaultValueUpdateProcessorTest, TestDocumentBuilder, DocValuesMissingTest, TestLegacyFieldCache, TestClusterStateMutator, PropertiesRequestHandlerTest, HttpPartitionTest, NodeMutatorTest, RandomizedTaggerTest, AdminHandlersProxyTest, TestCharFilters, TestSimPolicyCloud, TestLeaderElectionWithEmptyReplica, TestStressRecovery, ExternalFileFieldSortTest, TestCoreDiscovery, SuggesterTSTTest, TestSurroundQueryParser, TestCopyFieldCollectionResource, TestBadConfig, BinaryUpdateRequestHandlerTest, TestExplainDocTransformer, SystemCollectionCompatTest, JSONWriterTest, TestDynamicLoadingUrl, TransactionLogTest, LeaderElectionTest, SuggestComponentTest, TestPartialUpdateDeduplication, TestReload, SSLMigrationTest, BasicDistributedZk2Test, TestUnifiedSolrHighlighterWithoutStoredId, TestSchemaResource, FieldMutatingUpdateProcessorTest, TestConfigSetImmutable, TestAnalyzedSuggestions, CachingDirectoryFactoryTest, TestRequestStatusCollectionAPI, TestUseDocValuesAsStored2, HdfsRecoveryZkTest, SparseHLLTest, UUIDUpdateProcessorFallbackTest, TestSQLHandler, TestTlogReplayVsRecovery, SpatialHeatmapFacetsTest, TestTolerantSearch, ShardsWhitelistTest, TestInPlaceUpdatesStandalone, TestRandomDVFaceting, TestSolrCloudWithHadoopAuthPlugin, TestPHPSerializedResponseWriter, TestNonDefinedSimilarityFactory, TestElisionMultitermQuery, ZkCLITest, TestSizeLimitedDistributedMap, TestTrackingShardHandlerFactory, PeerSyncReplicationTest, BackupRestoreApiErrorConditionsTest, DistributedFacetPivotWhiteBoxTest, DistributedQueryElevationComponentTest, HighlighterTest, TestDocTermOrds, BasicAuthIntegrationTest, JsonLoaderTest, TestNestedDocsSort, ConvertedLegacyTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, TestDistributedMissingSort, TestDistributedSearch, ChaosMonkeySafeLeaderWithPullReplicasTest, DeleteLastCustomShardedReplicaTest, DistributedQueueTest, FullSolrCloudDistribCmdsTest, MissingSegmentRecoveryTest, MoveReplicaTest, OverseerRolesTest, OverseerTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, RestartWhileUpdatingTest, RollingRestartTest, ShardTermsTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestCloudDeleteByQuery, TestCloudSearcherWarming, TestCryptoKeys, TestLockTree, TestMiniSolrCloudClusterSSL, TestSolrCloudWithSecureImpersonation, TestStressLiveNodes, HdfsAutoAddReplicasIntegrationTest, HttpTriggerListenerTest, IndexSizeTriggerTest, TriggerSetPropertiesIntegrationTest, TestSimDistributedQueue, TestSimNodeAddedTrigger, TestSimNodeLostTrigger, TestSimTriggerIntegration, BaseCdcrDistributedZkTest, CdcrBidirectionalTest, CdcrBootstrapTest, HdfsTlogReplayBufferedWhileIndexingTest, HdfsUnloadDistributedZkTest, ImplicitSnitchTest, RuleEngineTest, RulesTest, TestMergePolicyConfig, PingRequestHandlerTest, TestCSVLoader, TestContainerPlugin, TestStressThreadBackup, TestSystemCollAutoCreate, XsltUpdateRequestHandlerTest, IndexSizeEstimatorTest, SegmentsInfoRequestHandlerTest, ThreadDumpHandlerTest, ZookeeperReadAPITest, DebugComponentTest, DistributedFacetExistsSmallTest, FacetPivotSmallTest, InfixSuggestersTest, QueryElevationComponentTest, TestPivotHelperCode, JavabinLoaderTest, EmbeddedSolrNoSerializeTest, TaggingAttributeTest, HighlighterMaxOffsetTest, CheckHdfsIndexTest, DateFieldTest, EnumFieldTest]
   [junit4] Completed [757/934 (1!)] on J2 in 1.75s, 15 tests, 1 error, 7 skipped <<< FAILURES!

[...truncated 51326 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1663 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1663/

All tests passed

Build Log:
[...truncated 67146 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1662 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1662/

All tests passed

Build Log:
[...truncated 67198 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1661 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1661/

All tests passed

Build Log:
[...truncated 67141 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1660 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1660/

1 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at https://127.0.0.1:46199/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46199/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14708 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 956316 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 956316 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 956317 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/data-dir-97-001
   [junit4]   2> 956317 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 956318 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 956318 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.SolrCloudTestCase Using per-replica state
   [junit4]   2> 956318 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001
   [junit4]   2> 956319 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 956319 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 956319 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 956320 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 956419 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 44913
   [junit4]   2> 956419 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44913
   [junit4]   2> 956419 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44913
   [junit4]   2> 956419 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44913
   [junit4]   2> 956455 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 956487 INFO  (zkConnectionManagerCallback-12561-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 956487 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 956495 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 956496 INFO  (zkConnectionManagerCallback-12563-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 956497 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 956497 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 956498 INFO  (zkConnectionManagerCallback-12565-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 956498 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 956499 WARN  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker-SendThread(127.0.0.1:44913)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1b3bc480002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 956620 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 956620 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 956620 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 956644 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 956644 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 956644 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 956699 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 956699 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 956699 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 956709 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20030c3c{/solr,null,AVAILABLE}
   [junit4]   2> 956721 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 956721 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 956721 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 956722 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@508c7e0a{/solr,null,AVAILABLE}
   [junit4]   2> 956722 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@23dd63f6{SSL, (ssl, http/1.1)}{127.0.0.1:46199}
   [junit4]   2> 956722 INFO  (jetty-launcher-12566-thread-1) [     ] o.e.j.s.Server Started @956757ms
   [junit4]   2> 956722 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44913/solr, hostPort=46199}
   [junit4]   2> 956722 ERROR (jetty-launcher-12566-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 956722 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 956723 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 956723 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 956723 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 956723 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T22:36:03.860Z
   [junit4]   2> 956727 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 956727 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3504e9c1{SSL, (ssl, http/1.1)}{127.0.0.1:39253}
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.e.j.s.Server Started @956762ms
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44913/solr, hostPort=39253}
   [junit4]   2> 956728 ERROR (jetty-launcher-12566-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 956728 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T22:36:03.865Z
   [junit4]   2> 956729 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 956729 INFO  (zkConnectionManagerCallback-12568-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 956729 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 956730 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 956732 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 956730 INFO  (zkConnectionManagerCallback-12570-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 956733 WARN  (jetty-launcher-12566-thread-1-SendThread(127.0.0.1:44913)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1b3bc480003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 956733 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 956836 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 956839 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 957151 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 957151 WARN  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 957152 WARN  (jetty-launcher-12566-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@477f87c7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957152 WARN  (jetty-launcher-12566-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@477f87c7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957154 WARN  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 957154 WARN  (jetty-launcher-12566-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@572030e2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957154 WARN  (jetty-launcher-12566-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@572030e2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957156 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44913/solr
   [junit4]   2> 957157 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 957157 INFO  (zkConnectionManagerCallback-12584-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 957157 INFO  (jetty-launcher-12566-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 957158 WARN  (jetty-launcher-12566-thread-1-SendThread(127.0.0.1:44913)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1b3bc480005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc480005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 957234 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 957234 WARN  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 957235 WARN  (jetty-launcher-12566-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2dfc9631[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957235 WARN  (jetty-launcher-12566-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2dfc9631[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957236 WARN  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 957239 WARN  (jetty-launcher-12566-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@639ac52e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957239 WARN  (jetty-launcher-12566-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@639ac52e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 957240 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44913/solr
   [junit4]   2> 957241 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 957242 INFO  (zkConnectionManagerCallback-12592-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 957242 INFO  (jetty-launcher-12566-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 957259 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 957263 INFO  (zkConnectionManagerCallback-12594-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 957263 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 957318 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46199_solr
   [junit4]   2> 957318 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.Overseer Overseer (id=73079812298113031-127.0.0.1:46199_solr-n_0000000000) starting
   [junit4]   2> 957324 INFO  (OverseerStateUpdate-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [n:127.0.0.1:46199_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:46199_solr
   [junit4]   2> 957329 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46199_solr
   [junit4]   2> 957331 INFO  (zkCallback-12593-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 957332 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 957332 WARN  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 957346 INFO  (jetty-launcher-12566-thread-1) [n:127.0.0.1:46199_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node1
   [junit4]   2> 957360 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 957361 INFO  (zkConnectionManagerCallback-12606-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 957361 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 957364 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 957366 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:39253_solr as DOWN
   [junit4]   2> 957367 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 957367 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39253_solr
   [junit4]   2> 957368 INFO  (zkCallback-12593-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 957368 INFO  (zkCallback-12605-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 957369 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 957369 WARN  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 957378 INFO  (jetty-launcher-12566-thread-2) [n:127.0.0.1:39253_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2
   [junit4]   2> 957385 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 957386 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 957386 INFO  (zkConnectionManagerCallback-12617-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 957386 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 957387 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 957388 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44913/solr ready
   [junit4]   2> 957407 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 957441 INFO  (OverseerThreadFactory-12601-thread-1-processing-n:127.0.0.1:46199_solr) [n:127.0.0.1:46199_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 957547 INFO  (OverseerStateUpdate-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [n:127.0.0.1:46199_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:39253_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:39253/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 957549 INFO  (OverseerStateUpdate-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [n:127.0.0.1:46199_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:46199_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:46199/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 957766 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 957767 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 957782 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 957790 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 957813 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 957813 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 957813 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 957814 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 957826 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 957832 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 957832 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 957832 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 957833 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 957851 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 957851 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 957852 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 957852 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 957858 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 957859 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 957859 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 957859 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692980231532445696
   [junit4]   2> 957860 INFO  (searcherExecutor-12619-thread-1-processing-n:127.0.0.1:46199_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 957869 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 957869 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 957869 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 957869 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 957871 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 957871 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 957876 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoute in=9997ms
   [junit4]   2> 957876 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 957876 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 957876 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 957876 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692980231550271488
   [junit4]   2> 957878 INFO  (searcherExecutor-12621-thread-1-processing-n:127.0.0.1:39253_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 957882 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 957882 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 958379 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 958379 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 958379 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:46199/solr/testOtherReplicasAreNotActive_shard1_replica_n2/
   [junit4]   2> 958379 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:46199/solr  START replicas=[https://127.0.0.1:39253/solr/testOtherReplicasAreNotActive_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 958380 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:46199/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 958387 INFO  (qtp1073513137-22120) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 958388 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 958388 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 958388 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73079812298113031-core_node4-n_0000000000
   [junit4]   2> 958392 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:46199/solr/testOtherReplicasAreNotActive_shard1_replica_n2/ shard1
   [junit4]   2> 958494 INFO  (zkCallback-12593-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958495 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 958498 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=731
   [junit4]   2> 958597 INFO  (zkCallback-12593-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958597 INFO  (zkCallback-12593-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958891 INFO  (qtp1073513137-22129) [n:127.0.0.1:39253_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1100
   [junit4]   2> 958897 INFO  (qtp690292870-22123) [n:127.0.0.1:46199_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 958990 INFO  (zkCallback-12593-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958990 INFO  (zkCallback-12605-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958990 INFO  (zkCallback-12605-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958990 INFO  (zkCallback-12593-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 958991 INFO  (qtp690292870-22123) [n:127.0.0.1:46199_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1553
   [junit4]   2> 958991 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 958995 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : https://127.0.0.1:39253/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/5 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:39253_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:39253/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:46199_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:46199/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 958995 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2033122766
   [junit4]   2> 958995 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39253_solr
   [junit4]   2> 958996 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 958996 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:39253_solr as DOWN
   [junit4]   2> 959000 INFO  (coreCloseExecutor-12633-thread-1) [n:127.0.0.1:39253_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4cffe22a
   [junit4]   2> 959000 INFO  (coreCloseExecutor-12633-thread-1) [n:127.0.0.1:39253_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n1 tag=SolrCore@4cffe22a
   [junit4]   2> 959000 INFO  (coreCloseExecutor-12633-thread-1) [n:127.0.0.1:39253_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@4cffe22a
   [junit4]   2> 959001 INFO  (coreCloseExecutor-12633-thread-1) [n:127.0.0.1:39253_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 959005 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 959005 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 959005 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 959005 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 959009 INFO  (zkCallback-12593-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 959010 INFO  (zkCallback-12616-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 959098 INFO  (zkCallback-12593-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 959098 INFO  (zkCallback-12593-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 959109 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@3504e9c1{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 959110 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@508c7e0a{/solr,null,STOPPED}
   [junit4]   2> 959110 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 959110 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 39253
   [junit4]   2> 959110 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 959114 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node4:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:46199_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:46199/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 959121 ERROR (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2208) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 40 more
   [junit4]   2> 959123 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 959123 ERROR (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 959123 INFO  (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=2
   [junit4]   2> 959123 ERROR (qtp690292870-22126) [n:127.0.0.1:46199_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 959126 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=39253)
   [junit4]   2> 959126 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 39253 try number 2 ...
   [junit4]   2> 959127 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 959129 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 959129 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 959129 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 959129 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@706a6842{/solr,null,AVAILABLE}
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@1c188158{SSL, (ssl, http/1.1)}{127.0.0.1:39253}
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.s.Server Started @959165ms
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44913/solr, hostPort=39253}
   [junit4]   2> 959130 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 959130 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T22:36:06.267Z
   [junit4]   2> 959131 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 959132 INFO  (zkConnectionManagerCallback-12637-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 959132 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 959132 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 959135 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 959443 INFO  (OverseerCollectionConfigSetProcessor-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [n:127.0.0.1:46199_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 959919 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 959919 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 959920 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@304415ca[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 959920 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@304415ca[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 959922 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 959923 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@8e6fffc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 959923 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@8e6fffc[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 959924 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44913/solr
   [junit4]   2> 959925 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 959926 INFO  (zkConnectionManagerCallback-12648-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 959926 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 960028 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 960029 INFO  (zkConnectionManagerCallback-12650-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 960029 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 960032 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 960035 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:39253_solr as DOWN
   [junit4]   2> 960036 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 960036 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39253_solr
   [junit4]   2> 960037 INFO  (zkCallback-12593-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 960037 INFO  (zkCallback-12616-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 960037 INFO  (zkCallback-12649-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 960038 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 960039 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 960053 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2
   [junit4]   2> 960053 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [n:127.0.0.1:39253_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [testOtherReplicasAreNotActive_shard1_replica_n1]
   [junit4]   2> 960061 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 960080 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 960081 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 960086 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 960092 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 960093 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 960093 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 960093 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 960119 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 960119 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 960119 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 960119 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 960120 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 960120 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 960120 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 960121 INFO  (coreLoadExecutor-12656-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692980233904324608
   [junit4]   2> 960122 INFO  (searcherExecutor-12658-thread-1-processing-n:127.0.0.1:39253_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 960122 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:39253_solr
   [junit4]   2> 960123 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[F13AE81473233C33]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testOtherReplicasAreNotActive
   [junit4]   2> 960127 INFO  (coreZkRegister-12638-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 960133 INFO  (coreZkRegister-12638-thread-1-processing-n:127.0.0.1:39253_solr) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkController Core needs to recover:testOtherReplicasAreNotActive_shard1_replica_n1
   [junit4]   2> 960135 INFO  (updateExecutor-12644-thread-1-processing-n:127.0.0.1:39253_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39253_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 960137 INFO  (zkCallback-12593-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 960137 INFO  (zkCallback-12593-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNot

[...truncated too long message...]

NIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1b3bc48000c, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 971095 INFO  (zkCallback-12593-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 971120 INFO  (closeThreadPool-12679-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73079812298113031-127.0.0.1:46199_solr-n_0000000000) closing
   [junit4]   2> 971144 INFO  (OverseerStateUpdate-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [n:127.0.0.1:46199_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46199_solr
   [junit4]   2> 971153 INFO  (OverseerAutoScalingTriggerThread-73079812298113031-127.0.0.1:46199_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 971155 INFO  (closeThreadPool-12679-thread-2) [     ] o.a.s.c.Overseer Overseer (id=73079812298113031-127.0.0.1:46199_solr-n_0000000000) closing
   [junit4]   2> 971197 INFO  (jetty-closer-12669-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@1c188158{SSL, (ssl, http/1.1)}{127.0.0.1:39253}
   [junit4]   2> 971197 INFO  (jetty-closer-12669-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@706a6842{/solr,null,STOPPED}
   [junit4]   2> 971197 INFO  (jetty-closer-12669-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 971297 INFO  (jetty-closer-12669-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73079812298113031-127.0.0.1:46199_solr-n_0000000000) closing
   [junit4]   2> 971298 INFO  (jetty-closer-12669-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@23dd63f6{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 971298 INFO  (jetty-closer-12669-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@20030c3c{/solr,null,STOPPED}
   [junit4]   2> 971298 INFO  (jetty-closer-12669-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 971299 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 971502 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/testOtherReplicasAreNotActive/terms/shard1
   [junit4]   2> 	8	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/configs/config
   [junit4]   2> 	3	/solr/collections/testLeaderFailsOver/terms/shard1
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	29	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/73079812298113031-127.0.0.1:46199_solr-n_0000000000
   [junit4]   2> 	2	/solr/collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73079812298113031-core_node4-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	42	/solr/overseer/queue
   [junit4]   2> 	16	/solr/collections
   [junit4]   2> 	16	/solr/overseer/collection-queue-work
   [junit4]   2> 	14	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 
   [junit4]   2> 971504 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:44913
   [junit4]   2> 971504 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44913
   [junit4]   2> 971504 INFO  (SUITE-LeaderTragicEventTest-seed#[F13AE81473233C33]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44913
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_F13AE81473233C33-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=lt-LT, timezone=Asia/Shanghai
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=123814080,total=521142272
   [junit4]   2> NOTE: All tests run in this JVM: [TestSweetSpotSimilarityFactory, TermsComponentTest, CoreAdminHandlerTest, TestSolrConfigHandler, TestSimNodeLostTrigger, SampleTest, TestUpdate, TestDistributedSearch, TestLogWatcher, AuditLoggerPluginTest, SystemInfoHandlerTest, ReplicationFactorTest, HttpPartitionOnCommitTest, TestReplicaProperties, SolrCLIZkUtilsTest, TestNamedUpdateProcessors, CdcrBootstrapTest, TestFacetMethods, RegexBoostProcessorTest, SuggestComponentContextFilterQueryTest, DirectSolrConnectionTest, SolrIndexConfigTest, TestCSVResponseWriter, TestStreamBody, TestLFUCache, RangeFacetCloudTest, RequestLoggingTest, TestFieldSortValues, TestQuerySenderNoQuery, SortByFunctionTest, TestManagedSynonymGraphFilterFactory, RoutingToNodesWithPropertiesTest, ChaosMonkeyNothingIsSafeTest, TestSolrXml, SignificantTermsQParserPluginTest, BasicFunctionalityTest, ScheduledMaintenanceTriggerTest, PeerSyncTest, TestConfigOverlay, TestRestoreCore, TestClusterProperties, CloneFieldUpdateProcessorFactoryTest, TestFreeTextSuggestions, XsltUpdateRequestHandlerTest, MoveReplicaHDFSTest, ZkNodePropsTest, TestDFRSimilarityFactory, ByteBuffersDirectoryFactoryTest, VMParamsZkACLAndCredentialsProvidersTest, DeleteReplicaTest, TestCrossCoreJoin, TestEmbeddedSolrServerAdminHandler, TestDistribPackageStore, FieldAnalysisRequestHandlerTest, StressHdfsTest, DataDrivenBlockJoinTest, TestLegacyBM25SimilarityFactory, SolrCoreMetricManagerTest, TestShortCircuitedRequests, TestSolrConfigHandlerCloud, TestSolr4Spatial2, TestSimComputePlanAction, EnumFieldTest, ConnectionReuseTest, TestInfoStreamLogging, OverseerCollectionConfigSetProcessorTest, TestQueryTypes, TestJsonFacetsStatsParsing, TestSearcherReuse, VersionInfoTest, ResourceLoaderTest, TestSortByMinMaxFunction, DistributedQueryComponentOptimizationTest, CollectionsAPISolrJTest, ManagedSchemaRoundRobinCloudTest, TestExternalRoleRuleBasedAuthorizationPlugin, DateMathParserTest, NestedShardedAtomicUpdateTest, TaggingAttributeTest, JavaBinAtomicUpdateMultivalueTest, TestFieldCacheWithThreads, TestOverriddenPrefixQueryForCustomFieldType, NodeLostTriggerIntegrationTest, HdfsBasicDistributedZkTest, TestSubQueryTransformerDistrib, TestConfigSetsAPIZkFailure, AnalyticsQueryTest, TestSimExtremeIndexing, CategoryRoutedAliasUpdateProcessorTest, TestDocSet, ShowFileRequestHandlerTest, TestSerializedLuceneMatchVersion, JWTAuthPluginIntegrationTest, TestRecoveryHdfs, URLClassifyProcessorTest, RankFieldTest, TestCloudNestedDocsSort, TestTestInjection, ExplicitHLLTest, DateRangeFieldTest, TestAddFieldRealTimeGet, NumberUtilsTest, LeaderTragicEventTest]
   [junit4] Completed [413/934 (1!)] on J1 in 15.28s, 2 tests, 1 error <<< FAILURES!

[...truncated 52480 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1659 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1659/

1 tests failed.
FAILED:  org.apache.solr.cloud.cdcr.CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
	at __randomizedtesting.SeedInfo.seed([E30E5AB8596A9292:34D975CFED350AD5]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:197)
	at org.apache.solr.cloud.cdcr.CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap(CdcrBootstrapTest.java:106)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14935 lines...]
   [junit4] Suite: org.apache.solr.cloud.cdcr.CdcrBootstrapTest
   [junit4]   2> 844342 INFO  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 844342 INFO  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/data-dir-70-001
   [junit4]   2> 844342 WARN  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
   [junit4]   2> 844342 INFO  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 844344 INFO  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 844344 INFO  (SUITE-CdcrBootstrapTest-seed#[E30E5AB8596A9292]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4] IGNOR/A 0.00s J1 | CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> 844346 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testBootstrapWithMultipleReplicas
   [junit4]   2> 844347 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-target-001
   [junit4]   2> 844347 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 844347 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 844347 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 844348 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 844447 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer start zk server on port: 44249
   [junit4]   2> 844447 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44249
   [junit4]   2> 844447 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44249
   [junit4]   2> 844447 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44249
   [junit4]   2> 844449 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844451 INFO  (zkConnectionManagerCallback-13104-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844451 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844454 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844455 INFO  (zkConnectionManagerCallback-13106-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844455 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844455 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844456 INFO  (zkConnectionManagerCallback-13108-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844456 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 844561 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 844566 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e2c5e3{/solr,null,AVAILABLE}
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@b72da3e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:34239}
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.e.j.s.Server Started @844597ms
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44249/solr, hostPort=34239}
   [junit4]   2> 844567 ERROR (jetty-launcher-13109-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:32.948Z
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 844567 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 844568 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@631b2a98{/solr,null,AVAILABLE}
   [junit4]   2> 844568 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844569 INFO  (zkConnectionManagerCallback-13111-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844569 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844569 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22c5011f{/solr,null,AVAILABLE}
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@702aad90{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:34863}
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-3) [     ] o.e.j.s.Server Started @844603ms
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44249/solr, hostPort=34863}
   [junit4]   2> 844573 ERROR (jetty-launcher-13109-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 844573 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:32.955Z
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@320650d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:46569}
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.e.j.s.Server Started @844604ms
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44249/solr, hostPort=46569}
   [junit4]   2> 844574 ERROR (jetty-launcher-13109-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 844574 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:32.955Z
   [junit4]   2> 844575 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844574 WARN  (jetty-launcher-13109-thread-1-SendThread(127.0.0.1:44249)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a10725ba0003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 844575 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 844576 INFO  (zkConnectionManagerCallback-13113-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844576 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844576 INFO  (zkConnectionManagerCallback-13115-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 844576 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 844576 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 844577 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 844579 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 844582 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 844585 WARN  (jetty-launcher-13109-thread-2-SendThread(127.0.0.1:44249)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a10725ba0005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 845037 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 845038 WARN  (jetty-launcher-13109-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5a58a4e8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845038 WARN  (jetty-launcher-13109-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5a58a4e8[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845040 WARN  (jetty-launcher-13109-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2003e11a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845040 WARN  (jetty-launcher-13109-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2003e11a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845041 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44249/solr
   [junit4]   2> 845042 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 845043 INFO  (zkConnectionManagerCallback-13132-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 845043 INFO  (jetty-launcher-13109-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 845145 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 845145 INFO  (zkConnectionManagerCallback-13134-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 845145 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 845203 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34239_solr
   [junit4]   2> 845203 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.Overseer Overseer (id=73079071037849607-127.0.0.1:34239_solr-n_0000000000) starting
   [junit4]   2> 845208 INFO  (OverseerStateUpdate-73079071037849607-127.0.0.1:34239_solr-n_0000000000) [n:127.0.0.1:34239_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:34239_solr
   [junit4]   2> 845208 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34239_solr
   [junit4]   2> 845209 INFO  (OverseerStateUpdate-73079071037849607-127.0.0.1:34239_solr-n_0000000000) [n:127.0.0.1:34239_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 845215 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 845215 WARN  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 845232 INFO  (jetty-launcher-13109-thread-1) [n:127.0.0.1:34239_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-target-001/node1
   [junit4]   2> 845786 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 845787 WARN  (jetty-launcher-13109-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3dbdcdf4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845788 WARN  (jetty-launcher-13109-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3dbdcdf4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845791 WARN  (jetty-launcher-13109-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1071873d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845791 WARN  (jetty-launcher-13109-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1071873d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 845792 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44249/solr
   [junit4]   2> 845795 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 845796 INFO  (zkConnectionManagerCallback-13152-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 845796 INFO  (jetty-launcher-13109-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 845797 WARN  (jetty-launcher-13109-thread-3-SendThread(127.0.0.1:44249)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a10725ba0008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a10725ba0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 845898 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 845899 INFO  (zkConnectionManagerCallback-13154-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 845899 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 845903 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 845906 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:34863_solr as DOWN
   [junit4]   2> 845907 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 845907 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34863_solr
   [junit4]   2> 845907 INFO  (zkCallback-13133-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 845908 INFO  (zkCallback-13153-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 845908 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 845909 WARN  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 845919 INFO  (jetty-launcher-13109-thread-3) [n:127.0.0.1:34863_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-target-001/node3
   [junit4]   2> 846064 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 846065 WARN  (jetty-launcher-13109-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5b8e3d4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846065 WARN  (jetty-launcher-13109-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5b8e3d4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846067 WARN  (jetty-launcher-13109-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@f2ef6c4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846067 WARN  (jetty-launcher-13109-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@f2ef6c4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846068 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44249/solr
   [junit4]   2> 846068 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846069 INFO  (zkConnectionManagerCallback-13168-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846069 INFO  (jetty-launcher-13109-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846171 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846172 INFO  (zkConnectionManagerCallback-13170-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846172 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846176 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 846179 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:46569_solr as DOWN
   [junit4]   2> 846180 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 846180 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46569_solr
   [junit4]   2> 846181 INFO  (zkCallback-13153-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 846181 INFO  (zkCallback-13133-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 846181 INFO  (zkCallback-13169-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 846182 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 846182 WARN  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 846197 INFO  (jetty-launcher-13109-thread-2) [n:127.0.0.1:46569_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-target-001/node2
   [junit4]   2> 846206 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
   [junit4]   2> 846206 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846207 INFO  (zkConnectionManagerCallback-13181-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846207 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846208 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 846209 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44249/solr ready
   [junit4]   1> Target zkHost = 127.0.0.1:44249/solr
   [junit4]   2> 846210 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001
   [junit4]   2> 846210 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 846210 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 846210 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 846211 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 846310 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer start zk server on port: 46731
   [junit4]   2> 846310 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:46731
   [junit4]   2> 846310 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:46731
   [junit4]   2> 846310 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 46731
   [junit4]   2> 846314 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846319 INFO  (zkConnectionManagerCallback-13183-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846319 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846323 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846328 INFO  (zkConnectionManagerCallback-13185-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846328 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846331 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846332 INFO  (zkConnectionManagerCallback-13187-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846332 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 846434 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 846451 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 846452 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 846455 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6352b4ff{/solr,null,AVAILABLE}
   [junit4]   2> 846455 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e5d6831{/solr,null,AVAILABLE}
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@e3d20e6{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:43547}
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a9a849{/solr,null,AVAILABLE}
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.e.j.s.Server Started @846486ms
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46731/solr, hostPort=43547}
   [junit4]   2> 846456 ERROR (jetty-launcher-13188-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3a978429{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:45707}
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.e.j.s.Server Started @846486ms
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46731/solr, hostPort=45707}
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 846456 ERROR (jetty-launcher-13188-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:34.837Z
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 846456 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:34.837Z
   [junit4]   2> 846457 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846458 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3e2fa525{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:39821}
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.e.j.s.Server Started @846489ms
   [junit4]   2> 846459 INFO  (zkConnectionManagerCallback-13190-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46731/solr, hostPort=39821}
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846459 ERROR (jetty-launcher-13188-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 846459 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-28T19:27:34.840Z
   [junit4]   2> 846460 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 846464 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 846468 INFO  (zkConnectionManagerCallback-13192-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846468 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846468 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846468 WARN  (jetty-launcher-13188-thread-3-SendThread(127.0.0.1:46731)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1072d050003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 846468 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 846469 INFO  (zkConnectionManagerCallback-13194-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846469 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846471 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 846471 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 846474 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 846475 WARN  (jetty-launcher-13188-thread-1-SendThread(127.0.0.1:46731)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1072d050004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 846475 WARN  (jetty-launcher-13188-thread-2-SendThread(127.0.0.1:46731)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1072d050005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 846694 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 846695 WARN  (jetty-launcher-13188-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@37521be0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846695 WARN  (jetty-launcher-13188-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@37521be0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846697 WARN  (jetty-launcher-13188-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@71dbde06[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846697 WARN  (jetty-launcher-13188-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@71dbde06[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846698 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46731/solr
   [junit4]   2> 846699 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846706 INFO  (zkConnectionManagerCallback-13211-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846706 INFO  (jetty-launcher-13188-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846711 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 846711 WARN  (jetty-launcher-13188-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5e933f20[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846711 WARN  (jetty-launcher-13188-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5e933f20[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846713 WARN  (jetty-launcher-13188-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1ebcbfe9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846713 WARN  (jetty-launcher-13188-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1ebcbfe9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 846714 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46731/solr
   [junit4]   2> 846714 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846715 INFO  (zkConnectionManagerCallback-13219-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846715 INFO  (jetty-launcher-13188-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846716 WARN  (jetty-launcher-13188-thread-2-SendThread(127.0.0.1:46731)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a1072d050007.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a1072d050007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 846815 INFO  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846827 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 846839 INFO  (zkConnectionManagerCallback-13221-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846839 INFO  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846840 INFO  (zkConnectionManagerCallback-13223-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 846840 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 846927 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39821_solr
   [junit4]   2> 846928 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.Overseer Overseer (id=73079071160205321-127.0.0.1:39821_solr-n_0000000000) starting
   [junit4]   2> 846939 INFO  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43547_solr
   [junit4]   2> 846948 INFO  (OverseerStateUpdate-73079071160205321-127.0.0.1:39821_solr-n_0000000000) [n:127.0.0.1:39821_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:39821_solr
   [junit4]   2> 846948 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:39821_solr as DOWN
   [junit4]   2> 846949 INFO  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 846949 WARN  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 846950 INFO  (OverseerStateUpdate-73079071160205321-127.0.0.1:39821_solr-n_0000000000) [n:127.0.0.1:39821_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 846959 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 846959 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39821_solr
   [junit4]   2> 846960 INFO  (zkCallback-13220-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 846961 INFO  (zkCallback-13222-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 846961 INFO  (zkCallback-13220-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 846961 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 846962 WARN  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 846982 INFO  (jetty-launcher-13188-thread-3) [n:127.0.0.1:43547_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node3
   [junit4]   2> 846982 INFO  (jetty-launcher-13188-thread-2) [n:127.0.0.1:39821_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node2
   [junit4]   2> 847245 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 847246 WARN  (jetty-launcher-13188-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4f1d78e4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 847246 WARN  (jetty-launcher-13188-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4f1d78e4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 847248 WARN  (jetty-launcher-13188-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@82b552a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 847248 WARN  (jetty-launcher-13188-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@82b552a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 847249 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46731/solr
   [junit4]   2> 847250 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 847251 INFO  (zkConnectionManagerCallback-13247-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 847251 INFO  (jetty-launcher-13188-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 847353 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 847354 INFO  (zkConnectionManagerCallback-13249-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 847354 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 847367 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 847370 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:45707_solr as DOWN
   [junit4]   2> 847370 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 847370 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45707_solr
   [junit4]   2> 847383 INFO  (zkCallback-13220-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 847383 INFO  (zkCallback-13222-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 847383 INFO  (zkCallback-13248-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 847385 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 847386 WARN  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 847396 INFO  (jetty-launcher-13188-thread-1) [n:127.0.0.1:45707_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node1
   [junit4]   2> 847418 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
   [junit4]   2> 847419 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 847419 INFO  (zkConnectionManagerCallback-13260-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 847420 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 847421 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 847422 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46731/solr ready
   [junit4]   2> 847427 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 847431 INFO  (zkConnectionManagerCallback-13262-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 847431 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithMultipleReplicas-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 847538 INFO  (OverseerThreadFactory-13234-thread-1-processing-n:127.0.0.1:39821_solr) [n:127.0.0.1:39821_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection cdcr-source
   [junit4]   2> 847644 INFO  (OverseerStateUpdate-73079071160205321-127.0.0.1:39821_solr-n_0000000000) [n:127.0.0.1:39821_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"cdcr-source_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:43547_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:43547/solr",
   [junit4]   2>   "collection":"cdcr-source",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 847646 INFO  (OverseerStateUpdate-73079071160205321-127.0.0.1:39821_solr-n_0000000000) [n:127.0.0.1:39821_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"cdcr-source_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:45707_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:45707/solr",
   [junit4]   2>   "collection":"cdcr-source",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 847648 INFO  (OverseerStateUpdate-73079071160205321-127.0.0.1:39821_solr-n_0000000000) [n:127.0.0.1:39821_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"cdcr-source_shard1_replica_n4",
   [junit4]   2>   "node_name":"127.0.0.1:39821_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:39821/solr",
   [junit4]   2>   "collection":"cdcr-source",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 847851 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr    x:cdcr-source_shard1_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-source&newCollection=true&collection=cdcr-source&version=2&replicaType=NRT&coreNodeName=core_node6&name=cdcr-source_shard1_replica_n4&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 847851 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr    x:cdcr-source_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-source&newCollection=true&collection=cdcr-source&version=2&replicaType=NRT&coreNodeName=core_node3&name=cdcr-source_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 847851 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr    x:cdcr-source_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 847852 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr    x:cdcr-source_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-source&newCollection=true&collection=cdcr-source&version=2&replicaType=NRT&coreNodeName=core_node5&name=cdcr-source_shard1_replica_n2&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 847866 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 847868 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 847871 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 847872 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 847873 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 847874 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 847875 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/cdcr-source/managed-schema
   [junit4]   2> 847877 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/cdcr-source/schema.xml to /configs/cdcr-source/schema.xml.bak
   [junit4]   2> 847877 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-source_shard1_replica_n1' using configuration from configset cdcr-source, trusted=true
   [junit4]   2> 847881 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 847881 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 847881 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-source_shard1_replica_n2' using configuration from configset cdcr-source, trusted=true
   [junit4]   2> 847884 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 847884 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 847884 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-source_shard1_replica_n4' using configuration from configset cdcr-source, trusted=true
   [junit4]   2> 847885 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.SolrCore [[cdcr-source_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node3/cdcr-source_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node3/cdcr-source_shard1_replica_n1/data/]
   [junit4]   2> 847885 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.SolrCore [[cdcr-source_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node1/cdcr-source_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node1/cdcr-source_shard1_replica_n2/data/]
   [junit4]   2> 847886 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.SolrCore [[cdcr-source_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node2/cdcr-source_shard1_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001/cdcr-source-001/node2/cdcr-source_shard1_replica_n4/data/]
   [junit4]   2> 847981 WARN  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.D.s.CdcrRequestHandler Solr loaded a deprecated plugin/analysis class [solr.CdcrRequestHandler]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 847981 WARN  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.h.CdcrRequestHandler CDCR (in its current form) is deprecated as of 8.6 and shall be removed in 9.0. See SOLR-14022 for details.
   [junit4]   2> 847984 WARN  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.h.CdcrRequestHandler CDCR (in its current form) is deprecated as of 8.6 and shall be removed in 9.0. See SOLR-14022 for details.
   [junit4]   2> 847985 WARN  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.h.CdcrRequestHandler CDCR (in its current form) is deprecated as of 8.6 and shall be removed in 9.0. See SOLR-14022 for details.
   [junit4]   2> 847993 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 847993 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 847993 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 847993 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 847993 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 847993 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 847994 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 847994 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 847994 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 847994 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 847994 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 847994 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 848001 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-source
   [junit4]   2> 848001 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-source
   [junit4]   2> 848001 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-source
   [junit4]   2> 848001 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-source
   [junit4]   2> 848001 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-source/managed-schema
   [junit4]   2> 848002 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-source
   [junit4]   2> 848002 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-source
   [junit4]   2> 848002 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-source/managed-schema
   [junit4]   2> 848002 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-source/managed-schema
   [junit4]   2> 848002 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 848002 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 848002 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 848002 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 848002 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 848002 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 848009 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-source/cdcr/state/buffer
   [junit4]   2> 848014 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-source/cdcr/state/process
   [junit4]   2> 848047 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692968373639446528
   [junit4]   2> 848047 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692968373639446528
   [junit4]   2> 848050 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692968373642592256
   [junit4]   2> 848053 INFO  (searcherExecutor-13266-thread-1-processing-n:127.0.0.1:45707_solr x:cdcr-source_shard1_replica_n2 c:cdcr-source s:shard1 r:core_node5) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 848053 INFO  (searcherExecutor-13268-thread-1-processing-n:127.0.0.1:39821_solr x:cdcr-source_shard1_replica_n4 c:cdcr-source s:shard1 r:core_node6) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n4]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 848054 INFO  (searcherExecutor-13264-thread-1-processing-n:127.0.0.1:43547_solr x:cdcr-source_shard1_replica_n1 c:cdcr-source s:shard1 r:core_node3) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 848058 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-source/terms/shard1 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 848058 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/cdcr-source/leaders/shard1
   [junit4]   2> 848059 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
   [junit4]   2> 848059 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-source/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 848060 INFO  (qtp16440969-21784) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/cdcr-source/leaders/shard1
   [junit4]   2> 848061 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
   [junit4]   2> 848061 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/cdcr-source/terms/shard1 to Terms{values={core_node6=0, core_node3=0, core_node5=0}, version=2}
   [junit4]   2> 848062 INFO  (qtp820534600-21792) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/cdcr-source/leaders/shard1
   [junit4]   2> 848064 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 848064 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 848064 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45707/solr/cdcr-source_shard1_replica_n2/
   [junit4]   2> 848064 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=cdcr-source_shard1_replica_n2 url=http://127.0.0.1:45707/solr  START replicas=[http://127.0.0.1:43547/solr/cdcr-source_shard1_replica_n1/, http://127.0.0.1:39821/solr/cdcr-source_shard1_replica_n4/] nUpdates=100
   [junit4]   2> 848071 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=cdcr-source_shard1_replica_n2 url=http://127.0.0.1:45707/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 848072 INFO  (qtp16440969-21791) [n:127.0.0.1:43547_solr c:cdcr-source s:shard1 r:core_node3 x:cdcr-source_shard1_replica_n1 ] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 848073 INFO  (qtp820534600-21783) [n:127.0.0.1:39821_solr c:cdcr-source s:shard1 r:core_node6 x:cdcr-source_shard1_replica_n4 ] o.a.s.c.S.Request [cdcr-source_shard1_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 848073 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 848073 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 848073 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/cdcr-source/leaders/shard1/leader after winning as /collections/cdcr-source/leader_elect/shard1/election/73079071160205323-core_node5-n_0000000000
   [junit4]   2> 848073 INFO  (zkCallback-13220-thread-1) [     ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-source:shard1
   [junit4]   2> 848073 INFO  (zkCallback-13222-thread-1) [     ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-source:shard1
   [junit4]   2> 848073 INFO  (zkCallback-13248-thread-1) [     ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-source:shard1
   [junit4]   2> 848076 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45707/solr/cdcr-source_shard1_replica_n2/ shard1
   [junit4]   2> 848178 INFO  (zkCallback-13248-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 848179 INFO  (qtp877685971-21790) [n:127.0.0.1:45707_solr c:cdcr-source s:shard1 r:core_node5 x:cdcr-source_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 848189 INFO  (zkCallback-13248-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 848189 INFO  (qtp877685971-21790) [n:127.0.0.1:4570

[...truncated too long message...]

collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1512674 INFO  (coreCloseExecutor-13622-thread-1) [n:127.0.0.1:44831_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1512676 INFO  (jetty-closer-13618-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1512676 INFO  (jetty-closer-13618-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1512676 INFO  (jetty-closer-13618-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1512676 INFO  (jetty-closer-13618-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1512676 INFO  (closeThreadPool-13624-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73079113966485509-127.0.0.1:44831_solr-n_0000000000) closing
   [junit4]   2> 1512676 INFO  (OverseerStateUpdate-73079113966485509-127.0.0.1:44831_solr-n_0000000000) [n:127.0.0.1:44831_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44831_solr
   [junit4]   2> 1512677 INFO  (OverseerAutoScalingTriggerThread-73079113966485509-127.0.0.1:44831_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1512679 INFO  (closeThreadPool-13624-thread-2) [     ] o.a.s.c.Overseer Overseer (id=73079113966485509-127.0.0.1:44831_solr-n_0000000000) closing
   [junit4]   2> 1512780 INFO  (jetty-closer-13618-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73079113966485509-127.0.0.1:44831_solr-n_0000000000) closing
   [junit4]   2> 1512781 INFO  (jetty-closer-13618-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2ecd867b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1512781 INFO  (jetty-closer-13618-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6e8b4b9b{/solr,null,STOPPED}
   [junit4]   2> 1512781 INFO  (jetty-closer-13618-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1512782 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1512782 WARN  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]-SendThread(127.0.0.1:33959)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103a11124790000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103a11124790000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103a11124790000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1512986 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/cdcr-target/terms/shard1
   [junit4]   2> 	2	/solr/collections/cdcr-target/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	3	/solr/collections/cdcr-target/cdcr/state/process
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/overseer/queue
   [junit4]   2> 	11	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1512988 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:33959
   [junit4]   2> 1512988 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:33959
   [junit4]   2> 1512988 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 33959
   [junit4]   2> 1512989 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[E30E5AB8596A9292]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testBootstrapWithSourceCluster
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.cdcr.CdcrBootstrapTest_E30E5AB8596A9292-001
   [junit4]   2> Feb 28, 2021 7:38:41 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {_root_=PostingsFormat(name=LuceneVarGapDocFreqInterval), xyz=PostingsFormat(name=LuceneFixedGap), id=Lucene84}, docValues:{_version_=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1878, maxMBSortInHeap=5.982963062419411, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=es-EC, timezone=Asia/Jerusalem
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=101799472,total=514326528
   [junit4]   2> NOTE: All tests run in this JVM: [EnumFieldTest, TestCloudPseudoReturnFields, SolrCloudReportersTest, TestJsonFacetsStatsParsing, DeleteReplicaTest, ManagedSchemaRoundRobinCloudTest, LoggingHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, TestStressLiveNodes, TestZkChroot, TestUpdate, TestPivotHelperCode, TestImpersonationWithHadoopAuth, SuggesterFSTTest, ZkNodePropsTest, TestDFRSimilarityFactory, AutoScalingHandlerTest, TestConfigReload, TestReplicaProperties, BJQFilterAccessibleTest, DaemonStreamApiTest, HdfsBasicDistributedZkTest, DocValuesNotIndexedTest, RegexBoostProcessorTest, SolrLogPostToolTest, HdfsLockFactoryTest, TestValueSourceCache, TestSubQueryTransformerDistrib, TestCollationFieldDocValues, TestInfoStreamLogging, TestHashPartitioner, TestFieldCacheWithThreads, TestCoreAdminApis, RoutingToNodesWithPropertiesTest, SyncSliceTest, TestExceedMaxTermLength, TestDistributedMap, BlockCacheTest, TestPackages, SolrCLIZkUtilsTest, TestLegacyBM25SimilarityFactory, CollectionsAPISolrJTest, TestStressLucene, HighlighterMaxOffsetTest, HdfsBackupRepositoryIntegrationTest, TestFieldCacheReopen, TestStreamBody, PeerSyncTest, TestJoin, TestRebalanceLeaders, FieldAnalysisRequestHandlerTest, TriggerEventQueueTest, DistributedFacetExistsSmallTest, TestSolr4Spatial2, TestUnifiedSolrHighlighter, TestClusterProperties, ClusterStateTest, DirectoryFactoriesTest, TestRawTransformer, TestCSVResponseWriter, TestUninvertingReader, TestBulkSchemaAPI, TestReversedWildcardFilterFactory, TestCoreContainer, HttpTriggerListenerTest, TestQueryTypes, SolrCoreMetricManagerTest, ChangedSchemaMergeTest, LargeFieldTest, BasicFunctionalityTest, SpellPossibilityIteratorTest, TestConfigOverlay, TestCloudDeleteByQuery, CdcrBootstrapTest]
   [junit4] Completed [491/934 (1!)] on J1 in 669.14s, 4 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 52237 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1658 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1658/

All tests passed

Build Log:
[...truncated 67157 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1657 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1657/

All tests passed

Build Log:
[...truncated 67157 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1656 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1656/

All tests passed

Build Log:
[...truncated 67171 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 68 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1655 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1655/

All tests passed

Build Log:
[...truncated 67145 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1654 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1654/

All tests passed

Build Log:
[...truncated 67145 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1653 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1653/

1 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at https://127.0.0.1:46605/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46605/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15001 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 1454853 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1454854 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1454854 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/data-dir-119-001
   [junit4]   2> 1454854 WARN  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=52 numCloses=52
   [junit4]   2> 1454854 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1454856 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1454856 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001
   [junit4]   2> 1454857 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1454857 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1454857 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1454858 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1454957 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 45321
   [junit4]   2> 1454957 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:45321
   [junit4]   2> 1454957 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45321
   [junit4]   2> 1454957 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45321
   [junit4]   2> 1454959 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1454962 INFO  (zkConnectionManagerCallback-13484-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1454962 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1454965 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1454966 INFO  (zkConnectionManagerCallback-13486-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1454966 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1454967 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1454970 INFO  (zkConnectionManagerCallback-13488-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1454970 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1455074 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d2939c1{/solr,null,AVAILABLE}
   [junit4]   2> 1455075 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51f5b31d{/solr,null,AVAILABLE}
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@360e9137{SSL, (ssl, http/1.1)}{127.0.0.1:39107}
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@7dbae5fc{SSL, (ssl, http/1.1)}{127.0.0.1:46605}
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.e.j.s.Server Started @1455128ms
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.e.j.s.Server Started @1455128ms
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45321/solr, hostPort=39107}
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45321/solr, hostPort=46605}
   [junit4]   2> 1455076 ERROR (jetty-launcher-13489-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1455076 ERROR (jetty-launcher-13489-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-27T17:16:24.268Z
   [junit4]   2> 1455076 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-27T17:16:24.268Z
   [junit4]   2> 1455077 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455078 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455078 INFO  (zkConnectionManagerCallback-13491-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455078 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455078 INFO  (zkConnectionManagerCallback-13493-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455078 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455079 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1455079 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1455097 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1455097 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1455098 WARN  (jetty-launcher-13489-thread-2-SendThread(127.0.0.1:45321)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1039b68b8b30004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1455098 WARN  (jetty-launcher-13489-thread-1-SendThread(127.0.0.1:45321)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1039b68b8b30003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1455416 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1455416 WARN  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1455417 WARN  (jetty-launcher-13489-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@65657864[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455417 WARN  (jetty-launcher-13489-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@65657864[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455420 WARN  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1455421 WARN  (jetty-launcher-13489-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@17b85ebd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455421 WARN  (jetty-launcher-13489-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@17b85ebd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455422 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45321/solr
   [junit4]   2> 1455424 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455425 INFO  (zkConnectionManagerCallback-13507-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455425 INFO  (jetty-launcher-13489-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455426 WARN  (jetty-launcher-13489-thread-2-SendThread(127.0.0.1:45321)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1039b68b8b30005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1455456 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1455457 WARN  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1455458 WARN  (jetty-launcher-13489-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@42c36aa4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455458 WARN  (jetty-launcher-13489-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@42c36aa4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455460 WARN  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1455464 WARN  (jetty-launcher-13489-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@18e297c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455464 WARN  (jetty-launcher-13489-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@18e297c6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1455465 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45321/solr
   [junit4]   2> 1455466 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455467 INFO  (zkConnectionManagerCallback-13515-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455467 INFO  (jetty-launcher-13489-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455527 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455528 INFO  (zkConnectionManagerCallback-13517-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455528 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455603 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46605_solr
   [junit4]   2> 1455604 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.Overseer Overseer (id=73072893045702663-127.0.0.1:46605_solr-n_0000000000) starting
   [junit4]   2> 1455616 INFO  (OverseerStateUpdate-73072893045702663-127.0.0.1:46605_solr-n_0000000000) [n:127.0.0.1:46605_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:46605_solr
   [junit4]   2> 1455617 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46605_solr
   [junit4]   2> 1455618 INFO  (OverseerStateUpdate-73072893045702663-127.0.0.1:46605_solr-n_0000000000) [n:127.0.0.1:46605_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1455623 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1455623 WARN  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1455632 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455632 INFO  (zkConnectionManagerCallback-13526-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455632 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455636 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1455637 INFO  (jetty-launcher-13489-thread-2) [n:127.0.0.1:46605_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node2
   [junit4]   2> 1455646 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:39107_solr as DOWN
   [junit4]   2> 1455649 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1455649 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39107_solr
   [junit4]   2> 1455650 INFO  (zkCallback-13516-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1455651 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1455652 WARN  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1455660 INFO  (zkCallback-13525-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1455669 INFO  (jetty-launcher-13489-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1
   [junit4]   2> 1455675 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1455675 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1455676 INFO  (zkConnectionManagerCallback-13540-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1455676 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1455677 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1455678 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45321/solr ready
   [junit4]   2> 1455695 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 1455742 INFO  (OverseerThreadFactory-13524-thread-1-processing-n:127.0.0.1:46605_solr) [n:127.0.0.1:46605_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 1455849 INFO  (OverseerStateUpdate-73072893045702663-127.0.0.1:46605_solr-n_0000000000) [n:127.0.0.1:46605_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:39107_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:39107/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1455851 INFO  (OverseerStateUpdate-73072893045702663-127.0.0.1:46605_solr-n_0000000000) [n:127.0.0.1:46605_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:46605_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:46605/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1456068 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1456069 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1456079 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1456085 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1456086 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1456086 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1456086 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 1456105 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1456113 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1456116 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1456116 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1456116 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1456116 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1456117 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1456118 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1456118 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1456118 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692869523207618560
   [junit4]   2> 1456130 INFO  (searcherExecutor-13542-thread-1-processing-n:127.0.0.1:46605_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1456134 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1456134 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1456134 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1456137 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1456138 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1456138 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoute in=9999ms
   [junit4]   2> 1456138 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1456161 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1456161 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1456162 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1456162 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1456163 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1456163 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1456163 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1456163 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692869523254804480
   [junit4]   2> 1456165 INFO  (searcherExecutor-13548-thread-1-processing-n:127.0.0.1:39107_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1456169 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1456169 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1456640 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1456640 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1456640 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:46605/solr/testOtherReplicasAreNotActive_shard1_replica_n2/
   [junit4]   2> 1456640 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:46605/solr  START replicas=[https://127.0.0.1:39107/solr/testOtherReplicasAreNotActive_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1456641 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=https://127.0.0.1:46605/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1456647 INFO  (qtp2046061122-21278) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1456647 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1456647 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1456647 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73072893045702663-core_node4-n_0000000000
   [junit4]   2> 1456651 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:46605/solr/testOtherReplicasAreNotActive_shard1_replica_n2/ shard1
   [junit4]   2> 1456752 INFO  (zkCallback-13516-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1456753 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1456756 INFO  (qtp843061247-21279) [n:127.0.0.1:46605_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=688
   [junit4]   2> 1456856 INFO  (zkCallback-13516-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1456856 INFO  (zkCallback-13516-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1457177 INFO  (qtp2046061122-21271) [n:127.0.0.1:39107_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1072
   [junit4]   2> 1457179 INFO  (qtp843061247-21274) [n:127.0.0.1:46605_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1457277 INFO  (zkCallback-13516-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1457277 INFO  (zkCallback-13525-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1457277 INFO  (zkCallback-13525-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1457277 INFO  (qtp843061247-21274) [n:127.0.0.1:46605_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1538
   [junit4]   2> 1457278 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 1457277 INFO  (zkCallback-13516-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1457281 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : https://127.0.0.1:39107/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/5 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:39107_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:39107/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:46605_solr",
   [junit4]   2>           "base_url":"https://127.0.0.1:46605/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 1457281 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=127163290
   [junit4]   2> 1457281 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39107_solr
   [junit4]   2> 1457282 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1457282 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:39107_solr as DOWN
   [junit4]   2> 1457283 INFO  (coreCloseExecutor-13556-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@21b73e07
   [junit4]   2> 1457283 INFO  (coreCloseExecutor-13556-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n1 tag=SolrCore@21b73e07
   [junit4]   2> 1457283 INFO  (coreCloseExecutor-13556-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@21b73e07
   [junit4]   2> 1457284 INFO  (coreCloseExecutor-13556-thread-1) [n:127.0.0.1:39107_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1457285 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1457285 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1457285 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1457285 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1457288 INFO  (zkCallback-13539-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1457288 INFO  (zkCallback-13516-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1457385 INFO  (zkCallback-13516-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1457385 INFO  (zkCallback-13516-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1457388 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@360e9137{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1457389 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d2939c1{/solr,null,STOPPED}
   [junit4]   2> 1457389 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1457389 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 39107
   [junit4]   2> 1457389 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 1457392 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node4:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:46605_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:46605/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 1457400 ERROR (qtp843061247-21277) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2208) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 40 more
   [junit4]   2> 1457402 INFO  (qtp843061247-21277) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1457402 ERROR (qtp843061247-21277) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1457402 INFO  (qtp843061247-21277) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=3
   [junit4]   2> 1457403 ERROR (qtp843061247-21277) [n:127.0.0.1:46605_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1457405 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=39107)
   [junit4]   2> 1457405 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 39107 try number 2 ...
   [junit4]   2> 1457405 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1457407 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1457407 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1457407 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1457407 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d4ca876{/solr,null,AVAILABLE}
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@7a7bb855{SSL, (ssl, http/1.1)}{127.0.0.1:39107}
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.s.Server Started @1457460ms
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:45321/solr, hostPort=39107}
   [junit4]   2> 1457408 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1457408 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-27T17:16:26.600Z
   [junit4]   2> 1457409 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1457409 INFO  (zkConnectionManagerCallback-13560-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1457410 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1457410 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1457413 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1457744 INFO  (OverseerCollectionConfigSetProcessor-73072893045702663-127.0.0.1:46605_solr-n_0000000000) [n:127.0.0.1:46605_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1458051 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1458052 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1458053 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@66d6bdf7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1458053 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@66d6bdf7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1458055 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1458056 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6a3f9c8a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1458056 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6a3f9c8a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1458057 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45321/solr
   [junit4]   2> 1458058 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1458059 INFO  (zkConnectionManagerCallback-13571-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1458059 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1458161 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1458162 INFO  (zkConnectionManagerCallback-13573-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1458162 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1458166 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1458169 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:39107_solr as DOWN
   [junit4]   2> 1458169 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1458170 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39107_solr
   [junit4]   2> 1458171 INFO  (zkCallback-13516-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1458171 INFO  (zkCallback-13572-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1458171 INFO  (zkCallback-13539-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1458172 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1458173 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1458188 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1
   [junit4]   2> 1458188 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [n:127.0.0.1:39107_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [testOtherReplicasAreNotActive_shard1_replica_n1]
   [junit4]   2> 1458199 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1458205 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1458206 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1458212 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1458217 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1458218 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1458218 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1458218 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1458243 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1458243 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1458244 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1458244 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1458245 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1458245 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1458245 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1458246 INFO  (coreLoadExecutor-13579-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692869525438988288
   [junit4]   2> 1458247 INFO  (searcherExecutor-13581-thread-1-processing-n:127.0.0.1:39107_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1458248 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:39107_solr
   [junit4]   2> 1458248 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[A2B7CB868F9A8160]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testOtherReplicasAreNotActive
   [junit4]   2> 1458252 INFO  (coreZkRegister-13561-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1458259 INFO  (coreZkRegister-13561-thread-1-processing-n:127.0.0.1:39107_solr) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkController Core needs to recover:testOtherReplicasAreNotActive_shard1_replica_n1
   [junit4]   2> 1458259 INFO  (updateExecutor-13567-thread-1-processing-n:127.0.0.1:39107_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:39107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1458271 INFO  (recoveryExecutor-13569-thread-1-processing-n:127.0.0.1:39107_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:cor

[...truncated too long message...]

t4]   2> 1469360 INFO  (jetty-closer-13592-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@51f5b31d{/solr,null,STOPPED}
   [junit4]   2> 1469360 INFO  (jetty-closer-13592-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1469361 INFO  (jetty-closer-13592-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@7a7bb855{SSL, (ssl, http/1.1)}{127.0.0.1:39107}
   [junit4]   2> 1469361 INFO  (jetty-closer-13592-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d4ca876{/solr,null,STOPPED}
   [junit4]   2> 1469361 INFO  (jetty-closer-13592-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1469362 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1469464 WARN  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker-SendThread(127.0.0.1:45321)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1039b68b8b30001.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1039b68b8b30001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1469565 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/testOtherReplicasAreNotActive/terms/shard1
   [junit4]   2> 	8	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/configs/config
   [junit4]   2> 	3	/solr/collections/testLeaderFailsOver/terms/shard1
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	29	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73072893045702663-core_node4-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/73072893045702663-127.0.0.1:46605_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/overseer/queue
   [junit4]   2> 	16	/solr/collections
   [junit4]   2> 	14	/solr/overseer/collection-queue-work
   [junit4]   2> 	14	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	12	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 
   [junit4]   2> 1469568 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:45321
   [junit4]   2> 1469568 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45321
   [junit4]   2> 1469568 INFO  (SUITE-LeaderTragicEventTest-seed#[A2B7CB868F9A8160]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45321
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_A2B7CB868F9A8160-001
   [junit4]   2> Feb 27, 2021 5:16:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=165, maxMBSortInHeap=6.9273415922288475, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=es-AR, timezone=US/Arizona
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=113667912,total=521666560
   [junit4]   2> NOTE: All tests run in this JVM: [TestPhraseSuggestions, TestLuceneIndexBackCompat, ResponseLogComponentTest, HdfsBasicDistributedZk2Test, TestSystemIdResolver, TestLazyCores, TestSimpleTextCodec, StatsReloadRaceTest, ReplaceNodeTest, DisMaxRequestHandlerTest, TestCloudConsistency, CollectionTooManyReplicasTest, DistributedVersionInfoTest, TestDFISimilarityFactory, TestFastLRUCache, TolerantUpdateProcessorTest, TestTolerantUpdateProcessorCloud, TestFieldCache, TestChildDocTransformer, TestFieldCacheVsDocValues, HdfsDirectoryTest, SpellCheckCollatorWithCollapseTest, DocValuesTest, TaggerTest, TestGraphMLResponseWriter, TestInPlaceUpdatesDistrib, TestMacroExpander, TestDistributedTracing, TestReqParamsAPI, DistributedExpandComponentTest, HighlighterConfigTest, IgnoreLargeDocumentProcessorFactoryTest, TestNestedUpdateProcessor, AliasIntegrationTest, TestScoreJoinQPScore, BasicZkTest, UnloadDistributedZkTest, TriggerCooldownIntegrationTest, DirectSolrSpellCheckerTest, RequestHandlersTest, TestDistributedMissingSort, SearchRateTriggerIntegrationTest, WordBreakSolrSpellCheckerTest, SolrMetricsIntegrationTest, TestStressInPlaceUpdates, TestLMJelinekMercerSimilarityFactory, PathHierarchyTokenizerFactoryTest, RecoveryZkTest, TestStandardQParsers, TestDocBasedVersionConstraints, TermVectorComponentTest, TestLockTree, SolrTestCaseJ4Test, TestSnapshotCoreBackup, ClassificationUpdateProcessorTest, TestStressUserVersions, UtilsToolTest, TestSimNodeAddedTrigger, CoreMergeIndexesAdminHandlerTest, FuzzySearchTest, TestBinaryResponseWriter, TestRandomCollapseQParserPlugin, TestStressThreadBackup, DistributedQueryComponentCustomSortTest, TestCollationField, TestRestManager, UpdateParamsTest, OverseerSolrResponseTest, HdfsAutoAddReplicasIntegrationTest, TestRandomRequestDistribution, TestRemoteStreaming, TestHttpShardHandlerFactory, TestCSVLoader, GraphQueryTest, CustomHighlightComponentTest, AuditLoggerIntegrationTest, TestCloudSearcherWarming, RestoreTriggerStateTest, TestRawResponseWriter, MetricsHistoryIntegrationTest, TestJsonFacets, TestLegacyTerms, MetricsHandlerTest, HdfsDirectoryFactoryTest, TestConfigSets, OverseerTest, TestInitQParser, TestExclusionRuleCollectionAccess, TestAuthorizationFramework, CdcrBidirectionalTest, OverriddenZkACLAndCredentialsProvidersTest, TestExportTool, TestConfigsApi, TestConfigSetsAPIShareSchema, SolrCoreTest, OutputWriterTest, ShardRoutingCustomTest, DeleteNodeTest, ClusterStateMockUtilTest, LeaderElectionContextKeyTest, SuggesterWFSTTest, OpenExchangeRatesOrgProviderTest, ZkStateReaderTest, InfoHandlerTest, SubstringBytesRefFilterTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, ConcurrentDeleteAndCreateCollectionTest, SliceStateTest, TestOrdValues, AtomicUpdatesTest, PrimitiveFieldTypeTest, MoreLikeThisComponentTest, BlockJoinFacetDistribTest, SplitByPrefixTest, CleanupOldIndexTest, CollectionStateFormat2Test, CreateCollectionCleanupTest, CreateRoutedAliasTest, DeleteShardTest, DeleteStatusTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, LeaderTragicEventTest]
   [junit4] Completed [506/934 (1!)] on J0 in 15.77s, 2 tests, 1 error <<< FAILURES!

[...truncated 52173 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1652 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1652/

All tests passed

Build Log:
[...truncated 67169 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1651 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1651/

All tests passed

Build Log:
[...truncated 67183 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1650 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1650/

All tests passed

Build Log:
[...truncated 67173 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1649 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1649/

All tests passed

Build Log:
[...truncated 67156 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1648 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1648/

All tests passed

Build Log:
[...truncated 67152 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1647 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1647/

All tests passed

Build Log:
[...truncated 67169 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 74 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1646 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1646/

All tests passed

Build Log:
[...truncated 67155 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1645 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1645/

All tests passed

Build Log:
[...truncated 67156 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1644 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1644/

All tests passed

Build Log:
[...truncated 67178 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1643 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1643/

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest

Error Message:
Error from server at http://127.0.0.1:37235/solr/collection1: {"collection1":10}

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37235/solr/collection1: {"collection1":10}
	at __randomizedtesting.SeedInfo.seed([61330BACF16832BE:15C3EAE9B54C7531]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1048)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1048)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1048)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1048)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1048)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1003)
	at org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest(TestCloudRecovery.java:129)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15083 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudRecovery
   [junit4]   2> 1446184 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1446184 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1446184 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/data-dir-134-001
   [junit4]   2> 1446184 WARN  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 1446184 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1446186 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1446186 INFO  (SUITE-TestCloudRecovery-seed#[61330BACF16832BE]-worker) [     ] o.a.s.c.SolrCloudTestCase Using per-replica state
   [junit4]   2> 1446189 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.SolrTestCaseJ4 ###Starting leaderRecoverFromLogOnStartupTest
   [junit4]   2> 1446190 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001
   [junit4]   2> 1446190 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1446190 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1446190 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1446191 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1446290 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer start zk server on port: 40401
   [junit4]   2> 1446290 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:40401
   [junit4]   2> 1446290 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40401
   [junit4]   2> 1446290 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40401
   [junit4]   2> 1446292 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446294 INFO  (zkConnectionManagerCallback-13767-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446294 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1446296 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446297 INFO  (zkConnectionManagerCallback-13769-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446297 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1446298 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446298 INFO  (zkConnectionManagerCallback-13771-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446298 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1446400 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1446400 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1446400 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1446400 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1446401 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1446401 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1446407 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@534a6516{/solr,null,AVAILABLE}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d63e348{/solr,null,AVAILABLE}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@45f5592c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:37235}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.e.j.s.Server Started @1446495ms
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40401/solr, hostPort=37235}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@6ad4bfa{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:41565}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.e.j.s.Server Started @1446495ms
   [junit4]   2> 1446408 ERROR (jetty-launcher-13772-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40401/solr, hostPort=41565}
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1446408 ERROR (jetty-launcher-13772-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T18:16:20.088Z
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1446408 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T18:16:20.088Z
   [junit4]   2> 1446415 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446416 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446416 INFO  (zkConnectionManagerCallback-13774-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446416 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1446416 INFO  (zkConnectionManagerCallback-13776-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446416 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1446417 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1446417 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1446422 WARN  (jetty-launcher-13772-thread-2-SendThread(127.0.0.1:40401)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103915511d40004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103915511d40004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103915511d40004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1446946 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1446947 WARN  (jetty-launcher-13772-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@23a715e3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1446947 WARN  (jetty-launcher-13772-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@23a715e3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1446949 WARN  (jetty-launcher-13772-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5d9fee87[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1446949 WARN  (jetty-launcher-13772-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5d9fee87[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1446950 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40401/solr
   [junit4]   2> 1446951 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1446952 INFO  (zkConnectionManagerCallback-13790-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1446952 INFO  (jetty-launcher-13772-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1447054 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1447060 INFO  (zkConnectionManagerCallback-13792-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1447060 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1447161 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41565_solr
   [junit4]   2> 1447161 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.Overseer Overseer (id=73061813525413894-127.0.0.1:41565_solr-n_0000000000) starting
   [junit4]   2> 1447171 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:41565_solr
   [junit4]   2> 1447174 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41565_solr
   [junit4]   2> 1447176 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1447176 WARN  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1447184 INFO  (zkCallback-13791-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1447190 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1447222 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41565.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447234 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41565.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447235 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41565.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447236 INFO  (jetty-launcher-13772-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node2
   [junit4]   2> 1447375 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1447375 WARN  (jetty-launcher-13772-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1c562f7b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1447376 WARN  (jetty-launcher-13772-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1c562f7b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1447378 WARN  (jetty-launcher-13772-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6e833f1a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1447378 WARN  (jetty-launcher-13772-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6e833f1a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1447380 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40401/solr
   [junit4]   2> 1447380 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1447381 INFO  (zkConnectionManagerCallback-13812-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1447381 INFO  (jetty-launcher-13772-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1447483 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1447484 INFO  (zkConnectionManagerCallback-13814-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1447484 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1447489 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1447493 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:37235_solr as DOWN
   [junit4]   2> 1447494 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1447494 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37235_solr
   [junit4]   2> 1447495 INFO  (zkCallback-13791-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1447495 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1447496 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1447497 WARN  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1447507 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1447527 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37235.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447536 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37235.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447536 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37235.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447537 INFO  (jetty-launcher-13772-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node1
   [junit4]   2> 1447555 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1447564 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1447567 INFO  (zkConnectionManagerCallback-13827-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1447567 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1447568 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1447569 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40401/solr ready
   [junit4]   2> 1447587 INFO  (OverseerThreadFactory-13799-thread-1-processing-n:127.0.0.1:41565_solr) [n:127.0.0.1:41565_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1447695 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"collection1_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:41565_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:41565/solr",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1447697 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"collection1_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:37235_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:37235/solr",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1447698 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"collection1_shard2_replica_n4",
   [junit4]   2>   "node_name":"127.0.0.1:41565_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:41565/solr",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1447700 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"collection1_shard2_replica_n6",
   [junit4]   2>   "node_name":"127.0.0.1:37235_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:37235/solr",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1447904 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr    x:collection1_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1447904 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr    x:collection1_shard2_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1447904 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr    x:collection1_shard2_replica_n4 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1447905 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr    x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1447905 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr    x:collection1_shard2_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1447915 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1447916 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1447918 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1447931 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1447933 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1447933 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1447933 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1447933 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1447934 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1447934 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41565.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447934 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1447934 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n6' using configuration from configset config, trusted=true
   [junit4]   2> 1447934 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node2/collection1_shard1_replica_n1/data/]
   [junit4]   2> 1447934 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1447934 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1447934 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37235.solr.core.collection1.shard2.replica_n6' (registry 'solr.core.collection1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447934 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node1/collection1_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node1/collection1_shard2_replica_n6/data/]
   [junit4]   2> 1447934 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37235.solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447935 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node1/collection1_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node1/collection1_shard1_replica_n2/data/]
   [junit4]   2> 1447937 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1447938 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1447938 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n4' using configuration from configset config, trusted=true
   [junit4]   2> 1447938 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41565.solr.core.collection1.shard2.replica_n4' (registry 'solr.core.collection1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@74a6b390
   [junit4]   2> 1447938 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node2/collection1_shard2_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001/tempDir-001/node2/collection1_shard2_replica_n4/data/]
   [junit4]   2> 1448023 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1448023 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1448024 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1448024 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1448026 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1448026 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1448026 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1448026 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1448027 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1448027 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1448028 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1448028 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1448030 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1448030 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1448032 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1448032 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1448032 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692692100375642112
   [junit4]   2> 1448033 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1448033 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1448033 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692692100376690688
   [junit4]   2> 1448035 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1448035 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1448036 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1448036 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692692100379836416
   [junit4]   2> 1448039 INFO  (searcherExecutor-13829-thread-1-processing-n:127.0.0.1:41565_solr x:collection1_shard1_replica_n1 c:collection1 s:shard1 r:core_node3) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1448039 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1448039 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1448040 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1448040 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1448042 INFO  (searcherExecutor-13833-thread-1-processing-n:127.0.0.1:37235_solr x:collection1_shard1_replica_n2 c:collection1 s:shard1 r:core_node5) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [collection1_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1448042 INFO  (searcherExecutor-13831-thread-1-processing-n:127.0.0.1:37235_solr x:collection1_shard2_replica_n6 c:collection1 s:shard2 r:core_node8) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.SolrCore [collection1_shard2_replica_n6]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1448044 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1448044 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1448044 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1448044 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 1448045 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1448045 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692692100389273600
   [junit4]   2> 1448048 INFO  (searcherExecutor-13835-thread-1-processing-n:127.0.0.1:41565_solr x:collection1_shard2_replica_n4 c:collection1 s:shard2 r:core_node7) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.SolrCore [collection1_shard2_replica_n4]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1448050 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 1448050 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
   [junit4]   2> 1448051 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoute in=9998ms
   [junit4]   2> 1448052 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 1448052 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
   [junit4]   2> 1448054 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 1448054 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
   [junit4]   2> 1448057 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1448057 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1448057 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37235/solr/collection1_shard2_replica_n6/
   [junit4]   2> 1448058 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n6 url=http://127.0.0.1:37235/solr  START replicas=[http://127.0.0.1:41565/solr/collection1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 1448058 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n6 url=http://127.0.0.1:37235/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1448059 INFO  (qtp141210759-21107) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.S.Request [collection1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1448060 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1448060 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1448060 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard2/leader after winning as /collections/collection1/leader_elect/shard2/election/73061813525413896-core_node8-n_0000000000
   [junit4]   2> 1448062 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37235/solr/collection1_shard2_replica_n6/ shard2
   [junit4]   2> 1448164 INFO  (zkCallback-13813-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448164 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448164 INFO  (zkCallback-13813-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448165 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1448169 INFO  (qtp1261616698-21109) [n:127.0.0.1:37235_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=264
   [junit4]   2> 1448268 INFO  (zkCallback-13813-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448268 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448268 INFO  (zkCallback-13813-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448268 INFO  (zkCallback-13813-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448552 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1448552 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1448552 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41565/solr/collection1_shard1_replica_n1/
   [junit4]   2> 1448556 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41565/solr  START replicas=[http://127.0.0.1:37235/solr/collection1_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1448556 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41565/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1448557 INFO  (qtp1261616698-21113) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1448557 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1448558 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1448558 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/collection1/leaders/shard1/leader after winning as /collections/collection1/leader_elect/shard1/election/73061813525413894-core_node3-n_0000000000
   [junit4]   2> 1448560 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41565/solr/collection1_shard1_replica_n1/ shard1
   [junit4]   2> 1448661 INFO  (zkCallback-13791-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448661 INFO  (zkCallback-13813-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448661 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448661 INFO  (zkCallback-13813-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448661 INFO  (zkCallback-13813-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448663 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1448668 INFO  (qtp141210759-21110) [n:127.0.0.1:41565_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=763
   [junit4]   2> 1448769 INFO  (zkCallback-13791-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448769 INFO  (zkCallback-13791-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448769 INFO  (zkCallback-13813-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448769 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448769 INFO  (zkCallback-13813-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1448769 INFO  (zkCallback-13813-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449055 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1151
   [junit4]   2> 1449058 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1154
   [junit4]   2> 1449060 INFO  (qtp1261616698-21111) [n:127.0.0.1:37235_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1449160 INFO  (zkCallback-13813-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449160 INFO  (zkCallback-13813-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449160 INFO  (zkCallback-13791-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449160 INFO  (zkCallback-13813-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449160 INFO  (zkCallback-13813-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449160 INFO  (zkCallback-13791-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1449161 INFO  (qtp1261616698-21111) [n:127.0.0.1:37235_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&collection.configName=config&maxShardsPerNode=2&name=collection1&nrtReplicas=2&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=1587
   [junit4]   2> 1449161 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: collection1
   [junit4]   2> 1449171 INFO  (qtp141210759-21112) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node3=1, core_node5=1}, version=2}
   [junit4]   2> 1449175 INFO  (qtp1261616698-21113) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:41565/solr/collection1_shard1_replica_n1/&wt=javabin&version=2}{add=[1 (1692692101565775872)]} 0 2
   [junit4]   2> 1449175 INFO  (qtp141210759-21112) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1692692101565775872)]} 0 9
   [junit4]   2> 1449179 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node7=1, core_node8=1}, version=2}
   [junit4]   2> 1449182 INFO  (qtp141210759-21105) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:37235/solr/collection1_shard2_replica_n6/&wt=javabin&version=2}{add=[2 (1692692101575213056)]} 0 1
   [junit4]   2> 1449182 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n6]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1692692101575213056)]} 0 6
   [junit4]   2> 1449184 INFO  (qtp141210759-21108) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:37235/solr/collection1_shard2_replica_n6/&wt=javabin&version=2}{add=[3 (1692692101582553088)]} 0 0
   [junit4]   2> 1449184 INFO  (qtp1261616698-21111) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n6]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3 (1692692101582553088)]} 0 1
   [junit4]   2> 1449186 INFO  (qtp1261616698-21115) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:41565/solr/collection1_shard1_replica_n1/&wt=javabin&version=2}{add=[4 (1692692101584650240)]} 0 0
   [junit4]   2> 1449186 INFO  (qtp141210759-21112) [n:127.0.0.1:41565_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4 (1692692101584650240)]} 0 1
   [junit4]   2> 1449190 INFO  (qtp1261616698-21114) [n:127.0.0.1:37235_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_n6 ] o.a.s.c.S.Request [collection1_shard2_replica_n6]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:7&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:37235/solr/collection1_shard2_replica_n6/|http://127.0.0.1:41565/solr/collection1_shard2_replica_n4/&rid=127.0.0.1-25237&rows=10&version=2&q=*:*&omitHeader=false&NOW=1614276982866&isShard=true&wt=javabin} hits=0 status=0 QTime=0
   [junit4]   2> 1449190 INFO  (qtp1261616698-21111) [n:127.0.0.1:37235_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_n2 ] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:7&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:37235/solr/collection1_shard1_replica_n2/|http://127.0.0.1:41565/solr/collection1_shard1_replica_n1/&rid=127.0.0.1-25237&rows=10&version=2&q=*:*&omitHeader=false&NOW=1614276982866&isShard=true&wt=javabin} hits=0 status=0 QTime=0
   [junit4]   2> 1449191 INFO  (qtp141210759-21107) [n:127.0.0.1:41565_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_n4 ] o.a.s.c.S.Request [collection1_shard2_replica_n4]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:7&wt=javabin&version=2} rid=127.0.0.1-25237 hits=0 status=0 QTime=4
   [junit4]   2> 1449193 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=952921469
   [junit4]   2> 1449193 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41565_solr
   [junit4]   2> 1449193 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1449193 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:41565_solr as DOWN
   [junit4]   2> 1449200 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1189945885
   [junit4]   2> 1449200 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37235_solr
   [junit4]   2> 1449200 INFO  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.c.SolrCore [collection1_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4914e7bd
   [junit4]   2> 1449200 INFO  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n1 tag=SolrCore@4914e7bd
   [junit4]   2> 1449200 INFO  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@477c36af: rootName = solr_41565, domain = solr.core.collection1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n1/com.codahale.metrics.MetricRegistry@423169fa
   [junit4]   2> 1449201 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1449201 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:37235_solr as DOWN
   [junit4]   2> 1449206 INFO  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.c.SolrCore [collection1_shard2_replica_n4]  CLOSING SolrCore org.apache.solr.core.SolrCore@36ee2d04
   [junit4]   2> 1449211 INFO  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.c.SolrCore [collection1_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@7f79cd74
   [junit4]   2> 1449211 INFO  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.c.SolrCore [collection1_shard2_replica_n6]  CLOSING SolrCore org.apache.solr.core.SolrCore@4ae5bb4b
   [junit4]   2> 1449211 INFO  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n2 tag=SolrCore@7f79cd74
   [junit4]   2> 1449211 INFO  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a331d60: rootName = solr_37235, domain = solr.core.collection1.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n2/com.codahale.metrics.MetricRegistry@28783fdb
   [junit4]   2> 1449225 INFO  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@4914e7bd
   [junit4]   2> 1449226 INFO  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@3ca92d17
   [junit4]   2> 1449226 WARN  (coreCloseExecutor-13858-thread-1) [n:127.0.0.1:41565_solr     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 1449226 INFO  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_n4 tag=SolrCore@36ee2d04
   [junit4]   2> 1449227 INFO  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6aab8794: rootName = solr_41565, domain = solr.core.collection1.shard2.replica_n4, service url = null, agent id = null] for registry solr.core.collection1.shard2.replica_n4/com.codahale.metrics.MetricRegistry@719d7ba8
   [junit4]   2> 1449235 INFO  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader tag=SolrCore@7f79cd74
   [junit4]   2> 1449235 INFO  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_n6 tag=SolrCore@4ae5bb4b
   [junit4]   2> 1449235 INFO  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3dbcec85: rootName = solr_37235, domain = solr.core.collection1.shard2.replica_n6, service url = null, agent id = null] for registry solr.core.collection1.shard2.replica_n6/com.codahale.metrics.MetricRegistry@45eb8543
   [junit4]   2> 1449235 INFO  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@57533ae7
   [junit4]   2> 1449236 WARN  (coreCloseExecutor-13860-thread-1) [n:127.0.0.1:37235_solr     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 1449257 INFO  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader tag=SolrCore@36ee2d04
   [junit4]   2> 1449257 INFO  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@20fe512d
   [junit4]   2> 1449257 WARN  (coreCloseExecutor-13858-thread-2) [n:127.0.0.1:41565_solr     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 1449260 INFO  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader tag=SolrCore@4ae5bb4b
   [junit4]   2> 1449260 INFO  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.u.TestInjection Inject failure: skipIndexWriterCommitOnClose=true: org.apache.solr.update.SolrIndexWriter@31c386f2
   [junit4]   2> 1449260 WARN  (coreCloseExecutor-13860-thread-2) [n:127.0.0.1:37235_solr     ] o.a.s.u.DirectUpdateHandler2 Skipping commit for IndexWriter.close() due to TestInjection
   [junit4]   2> 1449261 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1449261 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79f4afa9: rootName = solr_41565, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@3b410bf7
   [junit4]   2> 1449266 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1449266 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17e39551: rootName = solr_37235, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@4864df0
   [junit4]   2> 1449269 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1449269 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@297268de: rootName = solr_41565, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@5434172
   [junit4]   2> 1449273 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1449273 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76df4199: rootName = solr_41565, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@13eee6b3
   [junit4]   2> 1449273 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1449274 INFO  (closeThreadPool-13863-thread-2) [     ] o.a.s.c.Overseer Overseer (id=73061813525413894-127.0.0.1:41565_solr-n_0000000000) closing
   [junit4]   2> 1449276 INFO  (OverseerStateUpdate-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [n:127.0.0.1:41565_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41565_solr
   [junit4]   2> 1449279 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1449279 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2cfd54a1: rootName = solr_37235, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@5434172
   [junit4]   2> 1449282 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1449282 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@407c494: rootName = solr_37235, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@13eee6b3
   [junit4]   2> 1449282 INFO  (ChaosMonkey-13852-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1449288 INFO  (OverseerAutoScalingTriggerThread-73061813525413894-127.0.0.1:41565_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1449292 WARN  (jetty-launcher-13772-thread-1-SendThread(127.0.0.1:40401)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103915511d40008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103915511d40008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103915511d40008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1449293 INFO  (closeThreadPool-13863-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73061813525413894-127.0.0.1:41565_solr-n_0000000000) closing
   [junit4]   2> 1449392 INFO  (ChaosMonkey-13852-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73061813525413894-127.0.0.1:41565_solr-n_0000000000) closing
   [junit4]   2> 1449393 INFO  (zkCallback-13826-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 1449394 INFO  (ChaosMonkey-13852-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@45f5592c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1449394 INFO  (ChaosMonkey-13852-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@6ad4bfa{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1449394 INFO  (ChaosMonkey-13852-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d63e348{/solr,null,STOPPED}
   [junit4]   2> 1449394 INFO  (ChaosMonkey-13852-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1449395 INFO  (ChaosMonkey-13852-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@534a6516{/solr,null,STOPPED}
   [junit4]   2> 1449395 INFO  (ChaosMonkey-13852-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1449395 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 41565
   [junit4]   2> 1449395 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 37235
   [junit4]   2> 1449396 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=41565)
   [junit4]   2> 1449396 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=37235)
   [junit4]   2> 1449396 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 41565 try number 2 ...
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 37235 try number 2 ...
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1449397 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fc1669{/solr,null,AVAILABLE}
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@358dc28c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:41565}
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-1) [     ] o.e.j.s.Server Started @1449485ms
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2953238d{/solr,null,AVAILABLE}
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40401/solr, hostPort=41565}
   [junit4]   2> 1449398 ERROR (ChaosMonkey-13865-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1449398 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T18:16:23.079Z
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@69bfaa9f{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:37235}
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.e.j.s.Server Started @1449486ms
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40401/solr, hostPort=37235}
   [junit4]   2> 1449399 ERROR (ChaosMonkey-13865-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1449399 INFO  (ChaosMonkey-13865-thread-2) [     ] o.a.s.s

[...truncated too long message...]

7.0.0.1:44635_solr-n_0000000002) closing
   [junit4]   2> 1460034 INFO  (jetty-closer-14130-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2b11322d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44635}
   [junit4]   2> 1460034 INFO  (jetty-closer-14130-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e7461b4{/solr,null,STOPPED}
   [junit4]   2> 1460034 INFO  (jetty-closer-14130-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1460138 INFO  (jetty-closer-14130-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@10d52102{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:38217}
   [junit4]   2> 1460139 INFO  (jetty-closer-14130-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5e0b6b0f{/solr,null,STOPPED}
   [junit4]   2> 1460139 INFO  (jetty-closer-14130-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1460143 INFO  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1460144 WARN  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]-SendThread(127.0.0.1:45329)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x10391552a7c0000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x10391552a7c0000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x10391552a7c0000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1460346 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	9	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/collections/collection1/collectionprops.json
   [junit4]   2> 	4	/solr/configs/config
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	58	/solr/collections/collection1/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	49	/solr/overseer/queue
   [junit4]   2> 	23	/solr/collections/collection1/state.json
   [junit4]   2> 	15	/solr/live_nodes
   [junit4]   2> 	8	/solr/collections
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1460349 INFO  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:45329
   [junit4]   2> 1460349 INFO  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:45329
   [junit4]   2> 1460349 INFO  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 45329
   [junit4]   2> 1460350 INFO  (TEST-TestCloudRecovery.corruptedLogTest-seed#[61330BACF16832BE]) [     ] o.a.s.SolrTestCaseJ4 ###Ending corruptedLogTest
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_61330BACF16832BE-001
   [junit4]   2> Feb 25, 2021 6:16:34 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ar-SY, timezone=Europe/Riga
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=248273256,total=523239424
   [junit4]   2> NOTE: All tests run in this JVM: [ZkStateReaderTest, AssignTest, TestSchemaField, CdcrUpdateLogTest, ZookeeperReadAPITest, CreateCollectionCleanupTest, TestBinaryResponseWriter, DistributedVersionInfoTest, HdfsAutoAddReplicasIntegrationTest, SolrSlf4jReporterTest, TestRemoteStreaming, FuzzySearchTest, TestSolrFieldCacheBean, HLLUtilTest, TestLegacyTerms, TestAtomicUpdateErrorCases, TolerantUpdateProcessorTest, TestSimpleTrackingShardHandler, DateFieldTest, TestAuthorizationFramework, DistributedQueryComponentCustomSortTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, TestCloudSearcherWarming, TestStressThreadBackup, TestManagedSchemaAPI, AutoAddReplicasPlanActionTest, TestCSVLoader, TestLockTree, UtilsToolTest, SolrCmdDistributorTest, TestFieldTypeResource, DistributedUpdateProcessorTest, MetricsHandlerTest, SliceStateTest, PathHierarchyTokenizerFactoryTest, TestTolerantUpdateProcessorCloud, SpatialFilterTest, TestRecovery, UnloadDistributedZkTest, ReplaceNodeTest, DeleteNodeTest, HdfsBasicDistributedZk2Test, UninvertDocValuesMergePolicyTest, CoreSorterTest, HdfsWriteToMultipleCollectionsTest, TestReqParamsAPI, TestMaxScoreQueryParser, InfoHandlerTest, TestCloudConsistency, TestStandardQParsers, QueryEqualityTest, TestDistributedTracing, TestSchemaVersionResource, CdcrRequestHandlerTest, ResponseLogComponentTest, MetricsDisabledCloudTest, JavabinLoaderTest, HdfsDirectoryTest, RouteFieldTest, IndexSizeTriggerTest, LocalFSCloudIncrementalBackupTest, TestCustomStream, TestSolr4Spatial, TestFileDictionaryLookup, SimplePostToolTest, RulesTest, TestPostingsSolrHighlighter, TestCollapseQParserPlugin, TestSolrCoreSnapshots, CoreMergeIndexesAdminHandlerTest, TestCollationField, SplitByPrefixTest, TestGraphMLResponseWriter, TestFoldingMultitermQuery, SubstringBytesRefFilterTest, AnalysisAfterCoreReloadTest, TestSimNodeAddedTrigger, TestInitQParser, TestBinaryField, TestOrdValues, TestDistributedMissingSort, SimpleMLTQParserTest, ResponseHeaderTest, TestPseudoReturnFields, SolrCoreTest, TestJsonFacets, TestSolrCloudWithDelegationTokens, DirectSolrSpellCheckerTest, TestExclusionRuleCollectionAccess, TestFastLRUCache, DocumentAnalysisRequestHandlerTest, IgnoreLargeDocumentProcessorFactoryTest, TestPerFieldSimilarityWithDefaultOverride, TestFieldCache, CdcrBidirectionalTest, HdfsNNFailoverTest, AliasIntegrationTest, TestNestedUpdateProcessor, PreAnalyzedUpdateProcessorTest, LeaderElectionContextKeyTest, TestRandomRequestDistribution, TestTrieFacet, TestCustomSort, CoreAdminCreateDiscoverTest, OutputWriterTest, TestNumericTokenStream, TestInPlaceUpdatesDistrib, TestLuceneIndexBackCompat, FileUtilsTest, OverseerSolrResponseTest, SignatureUpdateProcessorFactoryTest, TestDelegationWithHadoopAuth, TestHighlightDedupGrouping, MultiThreadedOCPTest, TestDistribDocBasedVersion, HttpPartitionOnCommitTest, LeaderFailureAfterFreshStartTest, MetricsHistoryWithAuthIntegrationTest, OverriddenZkACLAndCredentialsProvidersTest, PackageManagerCLITest, ShardRoutingTest, TestCloudPseudoReturnFields, TestCloudRecovery]
   [junit4] Completed [539/934 (1!)] on J0 in 14.88s, 2 tests, 1 error <<< FAILURES!

[...truncated 52080 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1642 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1642/

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.test

Error Message:
Backup failure: the_backup expected null, but was:<codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(RAMInputStream(name=_0.si))))>

Stack Trace:
java.lang.AssertionError: Backup failure: the_backup expected null, but was:<codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(RAMInputStream(name=_0.si))))>
	at __randomizedtesting.SeedInfo.seed([F755F9CA3A144D43:7F01C61094E820BB]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.failNotNull(Assert.java:756)
	at org.junit.Assert.assertNull(Assert.java:738)
	at org.apache.solr.handler.BackupStatusChecker._checkBackupSuccess(BackupStatusChecker.java:208)
	at org.apache.solr.handler.BackupStatusChecker.checkBackupSuccess(BackupStatusChecker.java:187)
	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:96)
	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:72)
	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:417)
	at org.apache.solr.cloud.BasicDistributedZk2Test.test(BasicDistributedZk2Test.java:102)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14778 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 1393060 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1393061 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/data-dir-118-001
   [junit4]   2> 1393061 WARN  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1393061 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1393063 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1393063 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1393063 INFO  (SUITE-BasicDistributedZk2Test-seed#[F755F9CA3A144D43]-worker) [     ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1393068 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1393069 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1393070 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1393073 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1393168 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer start zk server on port: 38169
   [junit4]   2> 1393168 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:38169
   [junit4]   2> 1393168 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38169
   [junit4]   2> 1393168 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38169
   [junit4]   2> 1393179 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1393180 INFO  (zkConnectionManagerCallback-13880-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1393180 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1393340 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1393342 INFO  (zkConnectionManagerCallback-13882-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1393342 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1393347 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1393348 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1393349 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1393350 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1393351 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1393352 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1393353 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1393354 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1393355 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1393356 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1393357 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer put /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1393357 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 1393453 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1393453 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1393453 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1393455 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1393455 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1393455 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e2f06e8{/,null,AVAILABLE}
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@48d10292{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:46249}
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.s.Server Started @1393519ms
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/tempDir-001/control/data, hostContext=/, hostPort=46249, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/control-001/cores}
   [junit4]   2> 1393456 ERROR (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1393456 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T15:11:53.647Z
   [junit4]   2> 1393465 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1393465 INFO  (zkConnectionManagerCallback-13884-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1393465 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1393566 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1393566 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/../../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/control-001/solr.xml
   [junit4]   2> 1393569 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1393569 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1393570 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1394472 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1394475 WARN  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@54570328[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1394475 WARN  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@54570328[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1394479 WARN  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@75df10e7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1394479 WARN  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@75df10e7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1394480 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38169/solr
   [junit4]   2> 1394483 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394483 INFO  (zkConnectionManagerCallback-13895-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1394483 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394587 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394590 INFO  (zkConnectionManagerCallback-13897-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1394590 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394764 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46249_
   [junit4]   2> 1394764 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.Overseer Overseer (id=73061088264388612-127.0.0.1:46249_-n_0000000000) starting
   [junit4]   2> 1394769 INFO  (OverseerStateUpdate-73061088264388612-127.0.0.1:46249_-n_0000000000) [n:127.0.0.1:46249_     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:46249_
   [junit4]   2> 1394780 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46249_
   [junit4]   2> 1394782 INFO  (zkCallback-13896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1394784 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1394784 WARN  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1394803 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1394837 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1394849 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1394849 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1394850 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [n:127.0.0.1:46249_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/control-001/cores
   [junit4]   2> 1394862 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394863 INFO  (zkConnectionManagerCallback-13914-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1394863 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394864 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1394865 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38169/solr ready
   [junit4]   2> 1394871 INFO  (OverseerThreadFactory-13904-thread-1-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_     ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1394977 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_    x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1394977 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_    x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1395989 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1396001 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 1396030 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1396050 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
   [junit4]   2> 1396050 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1396050 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1396053 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=88.7978515625, floorSegmentMB=0.484375, forceMergeDeletesPctAllowed=0.40646780208658306, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6571968603118228, deletesPctAllowed=38.3414802897783
   [junit4]   2> 1396055 WARN  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1396095 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1396095 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1396096 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1396096 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1396096 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=70.8515625, floorSegmentMB=1.9208984375, forceMergeDeletesPctAllowed=15.36995327880952, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=34.71492688924941
   [junit4]   2> 1396098 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1396098 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1396098 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1396098 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692680497438654464
   [junit4]   2> 1396101 INFO  (searcherExecutor-13916-thread-1-processing-n:127.0.0.1:46249_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1396106 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1396106 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
   [junit4]   2> 1396110 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1396110 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1396110 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46249/control_collection_shard1_replica_n1/
   [junit4]   2> 1396111 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1396111 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:46249/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1396111 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/73061088264388612-core_node2-n_0000000000
   [junit4]   2> 1396114 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46249/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1396215 INFO  (zkCallback-13896-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1396215 INFO  (zkCallback-13896-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1396216 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1396220 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1243
   [junit4]   2> 1396222 INFO  (qtp1409802889-23157) [n:127.0.0.1:46249_     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1396490 INFO  (zkCallback-13896-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1396490 INFO  (zkCallback-13896-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1396490 INFO  (zkCallback-13896-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1396491 INFO  (qtp1409802889-23157) [n:127.0.0.1:46249_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:46249_&wt=javabin&version=2} status=0 QTime=1623
   [junit4]   2> 1396491 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
   [junit4]   2> 1396600 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1396600 INFO  (zkConnectionManagerCallback-13925-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1396600 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1396602 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1396604 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38169/solr ready
   [junit4]   2> 1396604 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1396614 INFO  (OverseerThreadFactory-13904-thread-2-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_     ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1396614 INFO  (OverseerCollectionConfigSetProcessor-73061088264388612-127.0.0.1:46249_-n_0000000000) [n:127.0.0.1:46249_     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1396820 WARN  (OverseerThreadFactory-13904-thread-2-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_     ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1396822 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1396822 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 1396823 INFO  (qtp1409802889-23159) [n:127.0.0.1:46249_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=218
   [junit4]   2> 1396823 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.c.ZkStateReader /collections/collection1/state.json is deleted, stop watching children
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 1396824 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
   [junit4]   2> 1396925 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001 of type NRT for shard2
   [junit4]   2> 1397101 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1397101 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1397101 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3ec7b269{/,null,AVAILABLE}
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@6a3a6ff6{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:35209}
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.e.j.s.Server Started @1397165ms
   [junit4]   2> 1397102 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=35209, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001/cores}
   [junit4]   2> 1397103 ERROR (closeThreadPool-13926-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1397103 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1397103 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1397103 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1397103 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1397103 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T15:11:57.294Z
   [junit4]   2> 1397104 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1397104 INFO  (zkConnectionManagerCallback-13928-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397104 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1397105 WARN  (closeThreadPool-13926-thread-1-SendThread(127.0.0.1:38169)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x10390ac34e70007.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e70007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e70007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1397197 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-2-001 of type NRT for shard1
   [junit4]   2> 1397206 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1397206 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001/solr.xml
   [junit4]   2> 1397207 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1397207 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1397208 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1397208 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1397208 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1397210 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1397222 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1397223 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1397223 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1397239 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72b6c430{/,null,AVAILABLE}
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4e8fc8e5{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:40461}
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.e.j.s.Server Started @1397310ms
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=40461, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-2-001/cores}
   [junit4]   2> 1397248 ERROR (closeThreadPool-13926-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1397248 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T15:11:57.439Z
   [junit4]   2> 1397274 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1397282 INFO  (zkConnectionManagerCallback-13933-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397282 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1397307 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-3-001 of type NRT for shard2
   [junit4]   2> 1397323 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1397323 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1397323 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1397349 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1397349 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1397349 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1397350 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@427b882e{/,null,AVAILABLE}
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@158c8371{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:36053}
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.e.j.s.Server Started @1397422ms
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=36053, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-3-001/cores}
   [junit4]   2> 1397359 ERROR (closeThreadPool-13926-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1397359 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T15:11:57.550Z
   [junit4]   2> 1397383 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1397395 INFO  (zkConnectionManagerCallback-13935-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397395 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1397395 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1397395 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-2-001/solr.xml
   [junit4]   2> 1397398 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1397398 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1397399 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1397620 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1397620 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-3-001/solr.xml
   [junit4]   2> 1397622 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1397622 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1397624 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1397630 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001 of type NRT for shard1
   [junit4]   2> 1397630 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1397630 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1397630 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1397685 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1397699 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1397699 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1397699 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1397699 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2cff37a{/,null,AVAILABLE}
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4b156dac{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44669}
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.e.j.s.Server Started @1397774ms
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/tempDir-001/jetty4, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=44669, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001/cores}
   [junit4]   2> 1397711 ERROR (closeThreadPool-13926-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1397711 WARN  (closeThreadPool-13926-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@39ce4115[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1397711 WARN  (closeThreadPool-13926-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@39ce4115[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1397711 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T15:11:57.902Z
   [junit4]   2> 1397735 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1397755 INFO  (zkConnectionManagerCallback-13946-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397755 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1397773 WARN  (closeThreadPool-13926-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@72db5944[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1397773 WARN  (closeThreadPool-13926-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@72db5944[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1397774 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38169/solr
   [junit4]   2> 1397795 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1397810 INFO  (zkConnectionManagerCallback-13951-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397810 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1397811 WARN  (closeThreadPool-13926-thread-1-SendThread(127.0.0.1:38169)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x10390ac34e7000b.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e7000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e7000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1398030 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1398030 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001/solr.xml
   [junit4]   2> 1398033 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1398033 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1398039 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1398061 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1398078 INFO  (zkConnectionManagerCallback-13953-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398079 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1398087 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1398095 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.ZkController Publish node=127.0.0.1:35209_ as DOWN
   [junit4]   2> 1398095 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1398095 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35209_
   [junit4]   2> 1398101 INFO  (zkCallback-13896-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1398102 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1398102 WARN  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1398119 INFO  (zkCallback-13924-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1398119 INFO  (zkCallback-13952-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1398124 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1398143 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398153 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398153 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398154 INFO  (closeThreadPool-13926-thread-1) [n:127.0.0.1:35209_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001/cores
   [junit4]   2> 1398203 INFO  (closeThreadPool-13926-thread-1) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:35209_
   [junit4]   2> 1398252 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1398271 WARN  (closeThreadPool-13926-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5bd1af9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398271 WARN  (closeThreadPool-13926-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5bd1af9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398302 WARN  (closeThreadPool-13926-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7f5f375a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398303 WARN  (closeThreadPool-13926-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7f5f375a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398304 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38169/solr
   [junit4]   2> 1398319 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1398349 INFO  (zkConnectionManagerCallback-13972-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398349 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1398350 WARN  (closeThreadPool-13926-thread-2-SendThread(127.0.0.1:38169)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x10390ac34e7000d.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e7000d, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x10390ac34e7000d, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1398415 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1398415 WARN  (closeThreadPool-13926-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@270558a1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398419 WARN  (closeThreadPool-13926-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@270558a1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398631 INFO  (OverseerCollectionConfigSetProcessor-73061088264388612-127.0.0.1:46249_-n_0000000000) [n:127.0.0.1:46249_     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1398633 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1398633 INFO  (zkConnectionManagerCallback-13978-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398633 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1398638 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1398641 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.ZkController Publish node=127.0.0.1:40461_ as DOWN
   [junit4]   2> 1398642 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1398642 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40461_
   [junit4]   2> 1398643 INFO  (zkCallback-13896-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1398643 INFO  (zkCallback-13924-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1398647 WARN  (closeThreadPool-13926-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@d6ce66d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398647 WARN  (closeThreadPool-13926-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@d6ce66d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1398648 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38169/solr
   [junit4]   2> 1398649 INFO  (zkCallback-13952-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1398651 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1398651 WARN  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1398655 INFO  (zkCallback-13977-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1398662 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1398663 INFO  (zkConnectionManagerCallback-13984-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398663 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1398671 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1398691 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398701 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398702 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1398703 INFO  (closeThreadPool-13926-thread-2) [n:127.0.0.1:40461_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-2-001/cores
   [junit4]   2> 1398734 INFO  (closeThreadPool-13926-thread-2) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:40461_
   [junit4]   2> 1398780 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1398781 INFO  (zkConnectionManagerCallback-13992-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398781 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1398784 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1398792 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.ZkController Publish node=127.0.0.1:36053_ as DOWN
   [junit4]   2> 1398793 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1398793 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36053_
   [junit4]   2> 1398794 INFO  (zkCallback-13952-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1398794 INFO  (zkCallback-13924-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1398794 INFO  (zkCallback-13896-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1398794 INFO  (zkCallback-13977-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1398795 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1398796 WARN  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1398996 INFO  (zkCallback-13991-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1399008 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1399041 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399064 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399064 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399065 INFO  (closeThreadPool-13926-thread-3) [n:127.0.0.1:36053_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-3-001/cores
   [junit4]   2> 1399111 INFO  (closeThreadPool-13926-thread-3) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:36053_
   [junit4]   2> 1399204 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 1399204 WARN  (closeThreadPool-13926-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1ecec6f6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1399205 WARN  (closeThreadPool-13926-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1ecec6f6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1399207 WARN  (closeThreadPool-13926-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6ee00391[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1399207 WARN  (closeThreadPool-13926-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6ee00391[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1399208 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38169/solr
   [junit4]   2> 1399210 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1399211 INFO  (zkConnectionManagerCallback-14008-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1399211 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1399562 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1399576 INFO  (zkConnectionManagerCallback-14010-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1399576 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1399595 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1399599 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.ZkController Publish node=127.0.0.1:44669_ as DOWN
   [junit4]   2> 1399600 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1399600 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44669_
   [junit4]   2> 1399601 INFO  (zkCallback-13952-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399601 INFO  (zkCallback-13924-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399602 INFO  (zkCallback-13896-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399602 INFO  (zkCallback-13977-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399602 INFO  (zkCallback-13991-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399603 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1399603 WARN  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1399623 INFO  (zkCallback-14009-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1399623 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1399650 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399662 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399662 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1399663 INFO  (closeThreadPool-13926-thread-4) [n:127.0.0.1:44669_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001/cores
   [junit4]   2> 1399691 INFO  (closeThreadPool-13926-thread-4) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:44669_
   [junit4]   2> 1399701 INFO  (OverseerThreadFactory-13904-thread-3-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_ c:collection1 s:shard2   ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:35209_ for creating new replica of shard shard2 for collection collection1
   [junit4]   2> 1399701 INFO  (OverseerThreadFactory-13904-thread-4-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_ c:collection1 s:shard1   ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44669_ for creating new replica of shard shard1 for collection collection1
   [junit4]   2> 1399703 INFO  (OverseerThreadFactory-13904-thread-3-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_ c:collection1 s:shard2   ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 1399704 INFO  (OverseerThreadFactory-13904-thread-4-processing-n:127.0.0.1:46249_) [n:127.0.0.1:46249_ c:collection1 s:shard1   ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 1399709 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_    x:collection1_shard2_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1399709 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_    x:collection1_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1400724 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1400724 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1400754 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 1400758 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 1400763 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1400766 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1400779 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from configset conf1, trusted=true
   [junit4]   2> 1400779 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1400780 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001/cores/collection1_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-4-001/cores/collection1_shard1_replica_n2/data/]
   [junit4]   2> 1400780 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n1' using configuration from configset conf1, trusted=true
   [junit4]   2> 1400781 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n1' (registry 'solr.core.collection1.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34d45baa
   [junit4]   2> 1400781 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001/cores/collection1_shard2_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001/shard-1-001/cores/collection1_shard2_replica_n1/data/]
   [junit4]   2> 1400781 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=88.7978515625, floorSegmentMB=0.484375, forceMergeDeletesPctAllowed=0.40646780208658306, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6571968603118228, deletesPctAllowed=38.3414802897783
   [junit4]   2> 1400783 INFO  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=88.7978515625, floorSegmentMB=0.484375, forceMergeDeletesPctAllowed=0.40646780208658306, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6571968603118228, deletesPctAllowed=38.3414802897783
   [junit4]   2> 1400783 WARN  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1400792 WARN  (qtp1845884654-23216) [n:127.0.0.1:35209_ c:collection1 s:shard2  x:collection1_shard2_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1400828 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1400828 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1400829 INFO  (qtp1328214161-23256) [n:127.0.0.1:44669_ c:collection1 s:shard1  x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 14008

[...truncated too long message...]

eeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1419517 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	29	/solr/collections/collection1/state.json
   [junit4]   2> 	19	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	12	/solr/aliases.json
   [junit4]   2> 	7	/solr/packages.json
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 	7	/solr/configs/conf1
   [junit4]   2> 	7	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	6	/solr/collections/collection1/collectionprops.json
   [junit4]   2> 	5	/solr/collections/onenodecollection/terms/shard1
   [junit4]   2> 	3	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	114	/solr/clusterstate.json
   [junit4]   2> 	30	/solr/collections/onenodecollection/state.json
   [junit4]   2> 	12	/solr/clusterprops.json
   [junit4]   2> 	12	/solr/collections/control_collection/state.json
   [junit4]   2> 	3	/solr/collections/collection1/leader_elect/shard1/election/73061088264388626-core_node4-n_0000000000
   [junit4]   2> 	3	/solr/overseer_elect/election/73061088264388620-127.0.0.1:35209_-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/73061088264388626-127.0.0.1:44669_-n_0000000004
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	70	/solr/overseer/queue
   [junit4]   2> 	62	/solr/live_nodes
   [junit4]   2> 	21	/solr/overseer/collection-queue-work
   [junit4]   2> 	18	/solr/collections
   [junit4]   2> 	12	/solr/collections/onenodecollection/state.json
   [junit4]   2> 	4	/solr/collections/control_collection/state.json
   [junit4]   2> 
   [junit4]   2> 1419519 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:38169
   [junit4]   2> 1419520 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38169
   [junit4]   2> 1419520 INFO  (TEST-BasicDistributedZk2Test.test-seed#[F755F9CA3A144D43]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38169
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=test -Dtests.seed=F755F9CA3A144D43 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=de-CH -Dtests.timezone=Etc/GMT+2 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 26.5s J2 | BasicDistributedZk2Test.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Backup failure: the_backup expected null, but was:<codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(RAMInputStream(name=_0.si))))>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F755F9CA3A144D43:7F01C61094E820BB]:0)
   [junit4]    > 	at org.apache.solr.handler.BackupStatusChecker._checkBackupSuccess(BackupStatusChecker.java:208)
   [junit4]    > 	at org.apache.solr.handler.BackupStatusChecker.checkBackupSuccess(BackupStatusChecker.java:187)
   [junit4]    > 	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:96)
   [junit4]    > 	at org.apache.solr.handler.BackupStatusChecker.waitForBackupSuccess(BackupStatusChecker.java:72)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:417)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.test(BasicDistributedZk2Test.java:102)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZk2Test_F755F9CA3A144D43-001
   [junit4]   2> Feb 25, 2021 3:12:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=SimpleText, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=de-CH, timezone=Etc/GMT+2
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=81755232,total=522715136
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtils, FieldMutatingUpdateProcessorTest, BackupRestoreApiErrorConditionsTest, SolrCloudExampleTest, TestCloudRecovery, TestLeaderElectionWithEmptyReplica, ScheduledTriggerIntegrationTest, TestNestedDocsSort, TestTlogReplayVsRecovery, TestTrackingShardHandlerFactory, TestUniqueKeyFieldResource, TestReloadAndDeleteDocs, NodeLostTriggerTest, TestQueryingOnDownCollection, TestCursorMarkWithoutUniqueKey, ZkCLITest, DistribJoinFromCollectionTest, TestTolerantSearch, TestConfigSetImmutable, TestMinimalConfig, ConcurrentCreateRoutedAliasTest, HdfsChaosMonkeyNothingIsSafeTest, SpellingQueryConverterTest, PropertiesRequestHandlerTest, RemoteQueryErrorTest, TestManagedResource, BlockDirectoryTest, SolrIndexSearcherTest, ShardSplitTest, TestHalfAndHalfDocValues, NodeMutatorTest, AuthToolTest, TestReplicationHandlerBackup, JvmMetricsTest, TestCoreDiscovery, TestElisionMultitermQuery, MoveReplicaTest, TestWordDelimiterFilterFactory, PreAnalyzedFieldManagedSchemaCloudTest, HealthCheckHandlerTest, AddBlockUpdateTest, TestFuzzyAnalyzedSuggestions, TestNonDefinedSimilarityFactory, AddSchemaFieldsUpdateProcessorFactoryTest, SOLR749Test, TestApiFramework, TestCloudInspectUtil, TestStressRecovery, TestSimDistribStateManager, SystemCollectionCompatTest, RegexBytesRefFilterTest, TestCloudManagedSchema, SparseHLLTest, OverseerModifyCollectionTest, LukeRequestHandlerTest, TestBlockCollapse, DocValuesMissingTest, TestRetrieveFieldsOptimizer, TestSizeLimitedDistributedMap, ForceLeaderTest, TriggerIntegrationTest, TestExactStatsCache, TestDynamicLoadingUrl, SolrShardReporterTest, ShardTermsTest, TestFilteredDocIdSet, TestRequestStatusCollectionAPI, TestSolrCachePerf, TransactionLogTest, TestUnInvertedFieldException, CleanupOldIndexTest, TestDistributedStatsComponentCardinality, SolrIndexMetricsTest, CheckHdfsIndexTest, TestJsonRequest, TestCopyFieldCollectionResource, CollectionsAPIDistributedZkTest, TestDocTermOrds, ActionThrottleTest, HdfsRecoveryZkTest, TestSimpleQParserPlugin, TestFieldCacheSort, TestSchemaResource, ZkShardTermsTest, V2ApiIntegrationTest, TestSimGenericDistributedQueue, TestXIncludeConfig, ImplicitSnitchTest, DebugComponentTest, AdminHandlersProxyTest, CurrencyRangeFacetCloudTest, IndexSizeTriggerMixedBoundsTest, DeleteShardTest, BinaryUpdateRequestHandlerTest, TestRequestForwarding, TestInitParams, TestSQLHandler, FacetPivotSmallTest, BadComponentTest, DeleteInactiveReplicaTest, TestPKIAuthenticationPlugin, TestJsonFacetsWithNestedObjects, DistributedFacetPivotLargeTest, TestLegacyFieldReuse, PeerSyncReplicationTest, TestOmitPositions, ShardsWhitelistTest, TestComplexPhraseQParserPlugin, TestFieldResource, AlternateDirectoryTest, FullHLLTest, TestQueryUtils, TestUseDocValuesAsStored2, SolrPluginUtilsTest, BasicDistributedZk2Test]
   [junit4] Completed [467/934 (1!)] on J2 in 27.34s, 1 test, 1 failure <<< FAILURES!

[...truncated 52412 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1641 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1641/

All tests passed

Build Log:
[...truncated 67163 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1640 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1640/

2 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at http://127.0.0.1:43617/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43617/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess

Error Message:
 Timeout waiting to see state for collection=testPeersyncFailureReplicationSuccess :DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={   "pullReplicas":"0",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node2":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",           "node_name":"127.0.0.1:46043_solr",           "base_url":"http://127.0.0.1:46043/solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"},         "core_node4":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",           "node_name":"127.0.0.1:34353_solr",           "base_url":"http://127.0.0.1:34353/solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"} Live Nodes: [127.0.0.1:34353_solr, 127.0.0.1:46043_solr] Last available state: DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={   "pullReplicas":"0",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node2":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",           "node_name":"127.0.0.1:46043_solr",           "base_url":"http://127.0.0.1:46043/solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"},         "core_node4":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",           "node_name":"127.0.0.1:34353_solr",           "base_url":"http://127.0.0.1:34353/solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: 
Timeout waiting to see state for collection=testPeersyncFailureReplicationSuccess :DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={
  "pullReplicas":"0",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
          "node_name":"127.0.0.1:46043_solr",
          "base_url":"http://127.0.0.1:46043/solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node4":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
          "node_name":"127.0.0.1:34353_solr",
          "base_url":"http://127.0.0.1:34353/solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"}
Live Nodes: [127.0.0.1:34353_solr, 127.0.0.1:46043_solr]
Last available state: DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={
  "pullReplicas":"0",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
          "node_name":"127.0.0.1:46043_solr",
          "base_url":"http://127.0.0.1:46043/solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node4":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
          "node_name":"127.0.0.1:34353_solr",
          "base_url":"http://127.0.0.1:34353/solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([CDE8B6F5B6482F5:D88FE8208ADAB596]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:336)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:313)
	at org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess(TestCloudSearcherWarming.java:218)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14917 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 1414487 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1414487 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1414487 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/data-dir-137-001
   [junit4]   2> 1414487 WARN  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=58 numCloses=58
   [junit4]   2> 1414487 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1414490 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1414490 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001
   [junit4]   2> 1414490 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1414491 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1414491 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1414491 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1414591 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 44407
   [junit4]   2> 1414591 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:44407
   [junit4]   2> 1414591 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:44407
   [junit4]   2> 1414591 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 44407
   [junit4]   2> 1414597 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1414602 INFO  (zkConnectionManagerCallback-12525-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1414602 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1414618 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1414623 INFO  (zkConnectionManagerCallback-12527-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1414623 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1414623 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1414624 INFO  (zkConnectionManagerCallback-12529-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1414624 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1414726 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1414730 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@71f7e567{/solr,null,AVAILABLE}
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@629af6e4{/solr,null,AVAILABLE}
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5c743e38{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:40991}
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.e.j.s.Server Started @1414767ms
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44407/solr, hostPort=40991}
   [junit4]   2> 1414731 ERROR (jetty-launcher-12530-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1414731 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T02:28:51.047Z
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5d459a95{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:43617}
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.e.j.s.Server Started @1414768ms
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44407/solr, hostPort=43617}
   [junit4]   2> 1414732 ERROR (jetty-launcher-12530-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1414732 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T02:28:51.048Z
   [junit4]   2> 1414733 INFO  (zkConnectionManagerCallback-12532-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1414733 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1414733 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1414734 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1414736 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1414738 INFO  (zkConnectionManagerCallback-12534-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1414738 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1414739 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1414738 WARN  (jetty-launcher-12530-thread-2-SendThread(127.0.0.1:44407)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038df19f2f0003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1414741 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1415286 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1415286 WARN  (jetty-launcher-12530-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@28d7ca08[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415286 WARN  (jetty-launcher-12530-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@28d7ca08[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415289 WARN  (jetty-launcher-12530-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@74c345b1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415289 WARN  (jetty-launcher-12530-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@74c345b1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415290 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44407/solr
   [junit4]   2> 1415291 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1415298 INFO  (zkConnectionManagerCallback-12548-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1415298 INFO  (jetty-launcher-12530-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1415299 WARN  (jetty-launcher-12530-thread-2-SendThread(127.0.0.1:44407)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038df19f2f0005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1415400 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1415401 INFO  (zkConnectionManagerCallback-12550-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1415401 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1415458 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40991_solr
   [junit4]   2> 1415458 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.Overseer Overseer (id=73058087865352198-127.0.0.1:40991_solr-n_0000000000) starting
   [junit4]   2> 1415470 INFO  (OverseerStateUpdate-73058087865352198-127.0.0.1:40991_solr-n_0000000000) [n:127.0.0.1:40991_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:40991_solr
   [junit4]   2> 1415473 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40991_solr
   [junit4]   2> 1415475 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1415475 WARN  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1415493 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1415502 INFO  (jetty-launcher-12530-thread-2) [n:127.0.0.1:40991_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node2
   [junit4]   2> 1415505 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1415514 WARN  (jetty-launcher-12530-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@424dfc36[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415514 WARN  (jetty-launcher-12530-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@424dfc36[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415525 WARN  (jetty-launcher-12530-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@32828d82[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415525 WARN  (jetty-launcher-12530-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@32828d82[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1415526 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44407/solr
   [junit4]   2> 1415530 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1415531 INFO  (zkConnectionManagerCallback-12568-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1415531 INFO  (jetty-launcher-12530-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1415635 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1415636 INFO  (zkConnectionManagerCallback-12570-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1415636 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1415640 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1415644 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:43617_solr as DOWN
   [junit4]   2> 1415644 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1415644 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43617_solr
   [junit4]   2> 1415646 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1415647 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1415647 WARN  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1415662 INFO  (zkCallback-12569-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1415666 INFO  (jetty-launcher-12530-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node1
   [junit4]   2> 1415684 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1415693 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1415705 INFO  (zkConnectionManagerCallback-12581-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1415705 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1415706 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1415707 INFO  (SUITE-LeaderTragicEventTest-seed#[CDE8B6F5B6482F5]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44407/solr ready
   [junit4]   2> 1415737 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 1415754 INFO  (OverseerThreadFactory-12557-thread-1-processing-n:127.0.0.1:40991_solr) [n:127.0.0.1:40991_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 1415865 INFO  (OverseerStateUpdate-73058087865352198-127.0.0.1:40991_solr-n_0000000000) [n:127.0.0.1:40991_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:43617_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:43617/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1415868 INFO  (OverseerStateUpdate-73058087865352198-127.0.0.1:40991_solr-n_0000000000) [n:127.0.0.1:40991_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:40991_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:40991/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1416075 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1416079 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1416079 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1416090 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1416097 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1416126 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1416126 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1416126 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1416127 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1416129 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1416130 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1416130 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1416130 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderTragicEventTest_CDE8B6F5B6482F5-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 1416163 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1416163 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1416164 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1416164 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1416164 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1416164 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1416165 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1416165 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1416166 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1416166 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1416166 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1416166 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1416166 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692632489637445632
   [junit4]   2> 1416167 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1416167 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1416167 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692632489638494208
   [junit4]   2> 1416170 INFO  (searcherExecutor-12583-thread-1-processing-n:127.0.0.1:43617_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1416170 INFO  (searcherExecutor-12585-thread-1-processing-n:127.0.0.1:40991_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1416174 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1416174 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1416174 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
   [junit4]   2> 1416175 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1416175 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1416179 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1416179 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1416179 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40991/solr/testOtherReplicasAreNotActive_shard1_replica_n2/
   [junit4]   2> 1416180 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=http://127.0.0.1:40991/solr  START replicas=[http://127.0.0.1:43617/solr/testOtherReplicasAreNotActive_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1416182 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n2 url=http://127.0.0.1:40991/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1416183 INFO  (qtp1401061013-19922) [n:127.0.0.1:43617_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1416183 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1416183 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1416183 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73058087865352198-core_node4-n_0000000000
   [junit4]   2> 1416185 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40991/solr/testOtherReplicasAreNotActive_shard1_replica_n2/ shard1
   [junit4]   2> 1416287 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416288 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1416290 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416290 INFO  (qtp1387514398-19927) [n:127.0.0.1:40991_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=212
   [junit4]   2> 1416290 INFO  (zkCallback-12549-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416399 INFO  (zkCallback-12549-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416399 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416399 INFO  (zkCallback-12549-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1416402 INFO  (zkCallback-12549-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417184 INFO  (qtp1401061013-19932) [n:127.0.0.1:43617_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1109
   [junit4]   2> 1417186 INFO  (qtp1401061013-19924) [n:127.0.0.1:43617_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1417284 INFO  (zkCallback-12569-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417284 INFO  (zkCallback-12549-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417284 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417284 INFO  (zkCallback-12549-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417284 INFO  (zkCallback-12549-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417284 INFO  (zkCallback-12569-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1417285 INFO  (qtp1401061013-19924) [n:127.0.0.1:43617_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1540
   [junit4]   2> 1417286 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 1417290 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : http://127.0.0.1:43617/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/4 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:43617_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:43617/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:40991_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:40991/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 1417290 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1983466360
   [junit4]   2> 1417290 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43617_solr
   [junit4]   2> 1417290 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1417290 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:43617_solr as DOWN
   [junit4]   2> 1417292 INFO  (coreCloseExecutor-12597-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7a4dea3f
   [junit4]   2> 1417292 INFO  (coreCloseExecutor-12597-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n1 tag=SolrCore@7a4dea3f
   [junit4]   2> 1417292 INFO  (coreCloseExecutor-12597-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@7a4dea3f
   [junit4]   2> 1417293 INFO  (coreCloseExecutor-12597-thread-1) [n:127.0.0.1:43617_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1417293 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1417293 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1417293 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1417293 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1417295 WARN  (jetty-launcher-12530-thread-1-SendThread(127.0.0.1:44407)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038df19f2f0008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038df19f2f0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1417296 INFO  (zkCallback-12549-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1417296 INFO  (zkCallback-12580-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1417393 INFO  (zkCallback-12549-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1417393 INFO  (zkCallback-12549-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1417393 INFO  (zkCallback-12549-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1417393 INFO  (zkCallback-12549-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1417397 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5d459a95{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1417398 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@629af6e4{/solr,null,STOPPED}
   [junit4]   2> 1417398 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1417398 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 43617
   [junit4]   2> 1417399 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 1417403 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node4:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:40991_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:40991/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 1417406 ERROR (qtp1387514398-19930) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2208) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 36 more
   [junit4]   2> 1417409 INFO  (qtp1387514398-19930) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1417409 ERROR (qtp1387514398-19930) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1417409 INFO  (qtp1387514398-19930) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=3
   [junit4]   2> 1417409 ERROR (qtp1387514398-19930) [n:127.0.0.1:40991_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1417411 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=43617)
   [junit4]   2> 1417411 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 43617 try number 2 ...
   [junit4]   2> 1417411 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1417434 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1417434 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1417434 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1417438 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a2e76bf{/solr,null,AVAILABLE}
   [junit4]   2> 1417438 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@161ccab3{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:43617}
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.s.Server Started @1417474ms
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:44407/solr, hostPort=43617}
   [junit4]   2> 1417439 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1417439 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-25T02:28:53.755Z
   [junit4]   2> 1417442 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1417444 INFO  (zkConnectionManagerCallback-12601-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1417444 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1417445 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1417449 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1417755 INFO  (OverseerCollectionConfigSetProcessor-73058087865352198-127.0.0.1:40991_solr-n_0000000000) [n:127.0.0.1:40991_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1417854 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1417855 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@193921bb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1417855 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@193921bb[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1417858 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5fdd64f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1417858 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5fdd64f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1417860 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44407/solr
   [junit4]   2> 1417861 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1417861 INFO  (zkConnectionManagerCallback-12612-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1417861 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1417964 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1417965 INFO  (zkConnectionManagerCallback-12614-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1417965 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1417969 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1417973 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:43617_solr as DOWN
   [junit4]   2> 1417973 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1417974 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[CDE8B6F5B6482F5]) [n:127.0.0.1:43617_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43617_solr
   [junit4]   2> 1417975 INFO  (zkCallback-12580-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1417975 INFO  (zkCallback-1

[...truncated too long message...]

 -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=Europe/Uzhgorod -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE  363s J0 | TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: 
   [junit4]    > Timeout waiting to see state for collection=testPeersyncFailureReplicationSuccess :DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={
   [junit4]    >   "pullReplicas":"0",
   [junit4]    >   "replicationFactor":"1",
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "range":"80000000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node2":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
   [junit4]    >           "node_name":"127.0.0.1:46043_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:46043/solr",
   [junit4]    >           "state":"down",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false"},
   [junit4]    >         "core_node4":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
   [junit4]    >           "node_name":"127.0.0.1:34353_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:34353/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false",
   [junit4]    >           "leader":"true"}}}},
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"2",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"1",
   [junit4]    >   "tlogReplicas":"0"}
   [junit4]    > Live Nodes: [127.0.0.1:34353_solr, 127.0.0.1:46043_solr]
   [junit4]    > Last available state: DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/12 )={
   [junit4]    >   "pullReplicas":"0",
   [junit4]    >   "replicationFactor":"1",
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "range":"80000000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node2":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
   [junit4]    >           "node_name":"127.0.0.1:46043_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:46043/solr",
   [junit4]    >           "state":"down",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false"},
   [junit4]    >         "core_node4":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
   [junit4]    >           "node_name":"127.0.0.1:34353_solr",
   [junit4]    >           "base_url":"http://127.0.0.1:34353/solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false",
   [junit4]    >           "leader":"true"}}}},
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"2",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"1",
   [junit4]    >   "tlogReplicas":"0"}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CDE8B6F5B6482F5:D88FE8208ADAB596]:0)
   [junit4]    > 	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:336)
   [junit4]    > 	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:313)
   [junit4]    > 	at org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess(TestCloudSearcherWarming.java:218)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudSearcherWarming_CDE8B6F5B6482F5-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=tr, timezone=Europe/Uzhgorod
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=112057776,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, TestLuceneMatchVersion, TestLMJelinekMercerSimilarityFactory, SplitShardTest, ShardRoutingCustomTest, UpdateRequestProcessorFactoryTest, MaxSizeAutoCommitTest, TestExportTool, MultiThreadedOCPTest, RecoveryZkTest, TestAtomicUpdateErrorCases, TestCloudConsistency, AnalyticsMergeStrategyTest, UninvertDocValuesMergePolicyTest, JWTVerificationkeyResolverTest, TestFieldCacheVsDocValues, TestStressInPlaceUpdates, DeleteNodeTest, SimpleMLTQParserTest, TestBinaryResponseWriter, TestNumericTerms64, XmlUpdateRequestHandlerTest, CollectionStateFormat2Test, GraphQueryTest, TestRandomRequestDistribution, IgnoreLargeDocumentProcessorFactoryTest, ZookeeperReadAPITest, TestDistributedMissingSort, HdfsDirectoryTest, DistributedQueryComponentCustomSortTest, TestSystemIdResolver, DocumentAnalysisRequestHandlerTest, UtilsToolTest, DistributedUpdateProcessorTest, QueryEqualityTest, SolrSlf4jReporterTest, TestPostingsSolrHighlighter, PreAnalyzedUpdateProcessorTest, TestConfigSets, TestCSVLoader, SolrCmdDistributorTest, FullSolrCloudDistribCmdsTest, SolrMetricsIntegrationTest, CustomHighlightComponentTest, ResponseHeaderTest, AutoAddReplicasPlanActionTest, TestWithCollection, TestPullReplica, TestRecovery, AtomicUpdatesTest, TestSegmentSorting, MetricsHandlerTest, BlockJoinFacetDistribTest, TestNestedUpdateProcessor, TestStressUserVersions, TestRemoteStreaming, DocValuesTest, BitVectorTest, TestMaxScoreQueryParser, TestSubQueryTransformerCrossCore, NodeAddedTriggerTest, BasicZkTest, TestSolr4Spatial, PeerSyncWithLeaderAndIndexFingerprintCachingTest, ConcurrentDeleteAndCreateCollectionTest, TestInPlaceUpdatesDistrib, TestTolerantUpdateProcessorCloud, TestGraphMLResponseWriter, TestLuceneIndexBackCompat, ResponseLogComponentTest, DistributedExpandComponentTest, TestRandomCollapseQParserPlugin, TestInitQParser, TestLockTree, TestCustomSort, TestLegacyTerms, TestSearchPerf, TestConfigsApi, TestOrdValues, TestSimTriggerIntegration, HLLUtilTest, TestDelegationWithHadoopAuth, TestExclusionRuleCollectionAccess, PathHierarchyTokenizerFactoryTest, TestNumericTokenStream, HdfsBasicDistributedZk2Test, TestRestManager, UpdateParamsTest, DOMUtilTest, OverriddenZkACLAndCredentialsProvidersTest, TestTextField, TestSimClusterStateProvider, MetricsDisabledCloudTest, TestDistribDocBasedVersion, CoreSorterTest, HdfsWriteToMultipleCollectionsTest, MetricsHistoryIntegrationTest, DistribCursorPagingTest, TestSolrIndexConfig, SpellCheckCollatorWithCollapseTest, TestPseudoReturnFields, TestLocalFSCloudBackupRestore, TestManagedSynonymFilterFactory, SubstringBytesRefFilterTest, TestNoOpRegenerator, TolerantUpdateProcessorTest, RulesTest, ChaosMonkeySafeLeaderWithPullReplicasTest, BackupIdTest, TestConfig, CoreAdminCreateDiscoverTest, TestAuthorizationFramework, DistributedFacetSimpleRefinementLongTailTest, RequestHandlersTest, MoveReplicaHDFSFailoverTest, SampleTest, TestDistributedGrouping, TestRandomFaceting, TestSolrCoreProperties, TestCharFilters, TestDeprecatedFilters, TestJettySolrRunner, ConnectionReuseTest, AliasIntegrationTest, ChaosMonkeySafeLeaderTest, CreateCollectionCleanupTest, DeleteInactiveReplicaTest, DistributedQueueTest, HttpPartitionWithTlogReplicasTest, LeaderTragicEventTest, MissingSegmentRecoveryTest, MoveReplicaTest, PackageManagerCLITest, ReplaceNodeTest, RestartWhileUpdatingTest, RollingRestartTest, SliceStateTest, SolrCLIZkUtilsTest, TestCloudPseudoReturnFields, TestCloudSearcherWarming]
   [junit4] Completed [590/934 (2!)] on J0 in 369.58s, 2 tests, 1 failure <<< FAILURES!

[...truncated 51912 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1639 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1639/

All tests passed

Build Log:
[...truncated 67148 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1638 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1638/

All tests passed

Build Log:
[...truncated 67151 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1637 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1637/

All tests passed

Build Log:
[...truncated 67154 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1636 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1636/

All tests passed

Build Log:
[...truncated 67158 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 74 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1635 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1635/

2 tests failed.
FAILED:  org.apache.solr.core.snapshots.TestSolrCloudSnapshots.testSnapshots

Error Message:
Error from server at http://127.0.0.1:37265/solr: Could not backup all shards

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37265/solr: Could not backup all shards
	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58:EA974E9EC4C07F17]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.core.snapshots.TestSolrCloudSnapshots.testSnapshots(TestSolrCloudSnapshots.java:184)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrJmxReporterTest.testClosedCore

Error Message:
Captured an uncaught exception in thread: Thread[id=10971, name=Thread-1410, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10971, name=Thread-1410, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]
	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58:ABA61C2191001FA8]:0)
Caused by: java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58]:0)
	at org.junit.Assert.fail(Assert.java:87)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.junit.Assert.assertNotNull(Assert.java:713)
	at org.junit.Assert.assertNotNull(Assert.java:723)
	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)




Build Log:
[...truncated 14447 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrJmxReporterTest
   [junit4]   2> 824940 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 824941 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-62-001
   [junit4]   2> 824941 WARN  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=75 numCloses=75
   [junit4]   2> 824941 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 824946 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 824947 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 824954 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testReloadCore
   [junit4]   2> 824955 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 824964 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 824996 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 825021 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 825033 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 825588 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 825588 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 825590 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@18863484[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 825590 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@18863484[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 825592 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 825593 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@765f162[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 825593 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@765f162[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 825594 WARN  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 825627 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 825635 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 825635 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 825636 INFO  (coreLoadExecutor-5780-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 825643 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 825661 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 825670 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 825678 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 825685 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 825685 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 825686 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-62-001/]
   [junit4]   2> 825687 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@14091630
   [junit4]   2> 825728 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 825728 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 825729 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=21.984375, floorSegmentMB=1.638671875, forceMergeDeletesPctAllowed=11.207628722565994, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.735980664267448, deletesPctAllowed=35.07858707194424
   [junit4]   2> 825729 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 825730 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 825731 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 825731 INFO  (searcherExecutor-5782-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 825779 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-fnppjctb.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 825791 ERROR (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties:
   [junit4]   2>           => java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
   [junit4]   2> java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/core.properties
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?]
   [junit4]   2> 	at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.Files.newByteChannel(Files.java:407) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384) ~[?:1.8.0_281]
   [junit4]   2> 	at java.nio.file.Files.newInputStream(Files.java:152) ~[?:1.8.0_281]
   [junit4]   2> 	at org.apache.solr.core.CorePropertiesLocator.buildCoreDescriptor(CorePropertiesLocator.java:187) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reloadCoreDescriptor(CoreContainer.java:1641) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1690) [java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1669) [java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest.testReloadCore(SolrJmxReporterTest.java:187) [test/:?]
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_281]
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_281]
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_281]
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_281]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [java/:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [java/:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [java/:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [java/:?]
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [java/:?]
   [junit4]   2> 	at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.1.jar:4.13.1]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.2.jar:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 825799 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 825816 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 825824 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 825831 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 825838 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1
   [junit4]   2> 825880 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 825880 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-62-001/]
   [junit4]   2> 825929 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 825929 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 825931 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 825931 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 825933 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 825934 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 825939 INFO  (searcherExecutor-5787-thread-1) [     ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 825940 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@321c1b60
   [junit4]   2> 825940 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@321c1b60
   [junit4]   2> 825940 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@361e6c30: rootName = SolrJmxReporterTest-fnppjctb, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3942da98
   [junit4]   2> 825951 INFO  (searcherExecutor-5787-thread-1) [     ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 825960 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a6d6c5a: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3942da98
   [junit4]   2> 826029 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-fnppjctb.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 826034 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 826034 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52ea0ec3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3942da98
   [junit4]   2> 826051 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@334bd869: rootName = SolrJmxReporterTest-fnppjctb, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3942da98
   [junit4]   2> 826067 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@321c1b60
   [junit4]   2> 826068 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 826068 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1148216346
   [junit4]   2> 826120 INFO  (coreCloseExecutor-5792-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1131452b
   [junit4]   2> 826120 INFO  (coreCloseExecutor-5792-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1131452b
   [junit4]   2> 826121 INFO  (coreCloseExecutor-5792-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 826122 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 826122 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a3b20fa: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@5dd31424
   [junit4]   2> 826128 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 826128 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60f1729c: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1dfc4796
   [junit4]   2> 826130 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 826130 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@201b968e: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@735f1ae8
   [junit4]   2> 826132 INFO  (TEST-SolrJmxReporterTest.testReloadCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReloadCore
   [junit4]   2> 826136 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testClosedCore
   [junit4]   2> 826136 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 826141 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 826156 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 826161 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-63-001
   [junit4]   2> 826164 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 826172 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 826675 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 826676 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 826677 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@11afb1c9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 826677 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@11afb1c9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 826680 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 826684 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@d568958[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 826684 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@d568958[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 826685 WARN  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 826713 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 826720 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 826720 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 826721 INFO  (coreLoadExecutor-5804-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 826728 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 826747 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 826772 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 826790 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 826801 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 826801 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 826801 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-63-001/]
   [junit4]   2> 826803 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@521f66fa
   [junit4]   2> 826851 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 826851 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 826852 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=21.984375, floorSegmentMB=1.638671875, forceMergeDeletesPctAllowed=11.207628722565994, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.735980664267448, deletesPctAllowed=35.07858707194424
   [junit4]   2> 826852 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 826853 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 826854 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 826854 INFO  (searcherExecutor-5806-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 826886 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-tqhflect.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 827387 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 827388 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77850e8a: rootName = SolrJmxReporterTest-tqhflect, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3e0ff0aa
   [junit4]   2> 827439 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@78e301fd: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@3e0ff0aa
   [junit4]   2> 827474 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@63001f3e
   [junit4]   2> 827474 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@63001f3e
   [junit4]   2> 827489 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> helmikuuta 24, 2021 7:10:58 AP. com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-1410,5,TGRP-SolrJmxReporterTest]
   [junit4]   2> java.lang.AssertionError
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58]:0)
   [junit4]   2> 	at org.junit.Assert.fail(Assert.java:87)
   [junit4]   2> 	at org.junit.Assert.assertTrue(Assert.java:42)
   [junit4]   2> 	at org.junit.Assert.assertNotNull(Assert.java:713)
   [junit4]   2> 	at org.junit.Assert.assertNotNull(Assert.java:723)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)
   [junit4]   2> 
   [junit4]   2> 829494 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 829494 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@63001f3e
   [junit4]   2> 829494 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 829494 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=613590388
   [junit4]   2> 829494 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 829495 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@607b67cc: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@287800a0
   [junit4]   2> 829501 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 829501 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@567436f7: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1dfc4796
   [junit4]   2> 829504 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 829504 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b536479: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@735f1ae8
   [junit4]   2> 829506 INFO  (TEST-SolrJmxReporterTest.testClosedCore-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testClosedCore
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrJmxReporterTest -Dtests.method=testClosedCore -Dtests.seed=DCDBCA01B1997D58 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=fi -Dtests.timezone=America/Miquelon -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   3.38s J3 | SolrJmxReporterTest.testClosedCore <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10971, name=Thread-1410, state=RUNNABLE, group=TGRP-SolrJmxReporterTest]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58:ABA61C2191001FA8]:0)
   [junit4]    > Caused by: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DCDBCA01B1997D58]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrJmxReporterTest$1.run(SolrJmxReporterTest.java:213)
   [junit4]   2> 829511 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testEnabled
   [junit4]   2> 829511 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 829517 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 829538 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 829544 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-64-001
   [junit4]   2> 829546 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 829553 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 830027 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 830027 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 830034 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@85f2be3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 830034 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@85f2be3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 830037 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 830037 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5fdf663d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 830037 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5fdf663d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 830039 WARN  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 830070 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 830077 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 830078 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 830079 INFO  (coreLoadExecutor-5822-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 830106 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 830122 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 830130 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 830144 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 830175 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 830176 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 830176 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-64-001/]
   [junit4]   2> 830196 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@b4f330a
   [junit4]   2> 830271 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 830271 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 830272 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=21.984375, floorSegmentMB=1.638671875, forceMergeDeletesPctAllowed=11.207628722565994, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.735980664267448, deletesPctAllowed=35.07858707194424
   [junit4]   2> 830272 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 830273 INFO  (coreLoadExecutor-5822-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 830274 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 830274 INFO  (searcherExecutor-5824-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 830349 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-yxbod.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 830441 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-quksjrg.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 830447 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.SolrMetricReporter Reporter disabled for registry solr.core.collection1
   [junit4]   2> 830490 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 830490 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f1aa2ae: rootName = SolrJmxReporterTest-hjlnkxd, domain = SolrJmxReporterTest-jfdhc, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/null
   [junit4]   2> 830490 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@33af9f19: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2c065637
   [junit4]   2> 830823 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6bfb1bfc: rootName = SolrJmxReporterTest-yxbod, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2c065637
   [junit4]   2> 830885 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41ee4822: rootName = SolrJmxReporterTest-quksjrg, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@2c065637
   [junit4]   2> 830902 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@44c636a9
   [junit4]   2> 830902 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 830902 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=620161563
   [junit4]   2> 831114 INFO  (coreCloseExecutor-5829-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@44c636a9
   [junit4]   2> 831114 INFO  (coreCloseExecutor-5829-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@44c636a9
   [junit4]   2> 831115 INFO  (coreCloseExecutor-5829-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 831129 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 831129 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cca1c83: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@48cd0910
   [junit4]   2> 831135 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 831136 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7b2aa798: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1dfc4796
   [junit4]   2> 831138 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 831138 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b38e409: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@735f1ae8
   [junit4]   2> 831157 INFO  (TEST-SolrJmxReporterTest.testEnabled-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testEnabled
   [junit4]   2> 831161 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testReportMetrics
   [junit4]   2> 831161 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 831166 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 831181 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 831189 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-65-001
   [junit4]   2> 831192 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 831199 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 832014 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 832014 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 832019 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@28ef14d1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 832019 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@28ef14d1[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 832023 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 832024 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@69f95a6d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 832024 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@69f95a6d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 832025 WARN  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 832058 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 832066 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 832066 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 832067 INFO  (coreLoadExecutor-5841-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 832077 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 832093 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 832102 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 832111 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 832118 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 832118 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2ead6b5f
   [junit4]   2> 832118 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.metrics.reporters.SolrJmxReporterTest_DCDBCA01B1997D58-001/data-dir-65-001/]
   [junit4]   2> 832119 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@12ea4800
   [junit4]   2> 832169 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 832169 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 832170 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=21.984375, floorSegmentMB=1.638671875, forceMergeDeletesPctAllowed=11.207628722565994, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.735980664267448, deletesPctAllowed=35.07858707194424
   [junit4]   2> 832170 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 832171 INFO  (coreLoadExecutor-5841-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 832172 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 832184 INFO  (searcherExecutor-5843-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 832262 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'SolrJmxReporterTest-xplstp.solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44ab0c26
   [junit4]   2> 832666 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=null
   [junit4]   2> 832667 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@236e39a7: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@9ea7ee
   [junit4]   2> 832709 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f7b9952: rootName = SolrJmxReporterTest-xplstp, domain = solr.core.collection1, service url = null, agent id = localhost_1614161455818] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@9ea7ee
   [junit4]   2> 832734 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1f3e5e1e
   [junit4]   2> 832735 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 832735 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=601687967
   [junit4]   2> 832737 INFO  (coreCloseExecutor-5848-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1f3e5e1e
   [junit4]   2> 832738 INFO  (coreCloseExecutor-5848-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@1f3e5e1e
   [junit4]   2> 832738 INFO  (coreCloseExecutor-5848-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 832740 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 832740 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c99ec72: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@1da361ea
   [junit4]   2> 832747 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 832747 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6d6c5b04: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1dfc4796
   [junit4]   2> 832750 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 832750 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30220828: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@735f1ae8
   [junit4]   2> 832753 INFO  (TEST-SolrJmxReporterTest.testReportMetrics-seed#[DCDBCA01B1997D58]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testReportMetrics
   [junit4]   2> 832753 INFO  (SUITE-SolrJmxReporterTest-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=1126, maxMBSortInHeap=6.346313322732645, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=fi, timezone=America/Miquelon
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=320580496,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: [TestDeprecatedFilters, InfixSuggestersTest, TestDefaultStatsCache, TestSortableTextField, HDFSCollectionsAPITest, TestTermsQParserPlugin, TestCloudPhrasesIdentificationComponent, UpdateLogTest, LegacyCloudClusterPropTest, TestSchemaSimilarityResource, AtomicUpdateProcessorFactoryTest, PreAnalyzedFieldTest, SaslZkACLProviderTest, TestSuggestSpellingConverter, MBeansHandlerTest, DistributedSpellCheckComponentTest, CursorMarkTest, ZkControllerTest, TestPushWriter, TestPrepRecovery, OverseerTaskQueueTest, TestGeoJSONResponseWriter, SolrMetricReporterTest, TestTlogReplica, SolrCoreCheckLockOnStartupTest, TestRTGBase, DistributedQueueTest, TestLegacyNumericRangeQueryBuilder, TestIndexingPerformance, AutoscalingHistoryHandlerTest, TriggerSetPropertiesIntegrationTest, RAMDirectoryFactoryTest, TestNumericTerms32, TestInPlaceUpdateWithRouteField, TestSSLRandomization, SpellCheckComponentTest, TestManagedResourceStorage, HdfsCollectionsAPIDistributedZkTest, TestDeleteCollectionOnDownNodes, TestSkipOverseerOperations, ConnectionManagerTest, TestSolrQueryResponse, DistributedDebugComponentTest, DimensionalRoutedAliasUpdateProcessorTest, HighlighterWithoutStoredIdTest, TestJsonRangeFacets, SolrXmlInZkTest, TestSmileRequest, TestNRTOpen, TestExtendedDismaxParser, TestSolrJacksonAnnotation, SplitHandlerTest, HttpPartitionWithTlogReplicasTest, CrossCollectionJoinQueryTest, TestCircuitBreaker, DistributedFacetPivotLongTailTest, ForceLeaderWithTlogReplicasTest, DocumentBuilderTest, MinimalSchemaTest, ChaosMonkeySafeLeaderTest, AutoAddReplicasIntegrationTest, SharedFSAutoReplicaFailoverTest, MergeStrategyTest, DistributedMLTComponentTest, ConcurrentCreateCollectionTest, TestNumericRangeQuery64, PeerSyncWithIndexFingerprintCachingTest, TestFiltering, TestSimScenario, SuggesterTest, SolrIndexSplitterTest, TestSimLargeCluster, TestShardHandlerFactory, TestStressCloudBlindAtomicUpdates, HdfsRestartWhileUpdatingTest, SolrJmxReporterTest]
   [junit4] Completed [342/934 (1!)] on J3 in 8.07s, 4 tests, 1 error <<< FAILURES!

[...truncated 1060 lines...]
   [junit4] Suite: org.apache.solr.core.snapshots.TestSolrCloudSnapshots
   [junit4]   2> 1898849 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1898850 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.core.snapshots.TestSolrCloudSnapshots_DCDBCA01B1997D58-001/data-dir-172-001
   [junit4]   2> 1898850 WARN  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1898850 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1898852 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 1898852 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1898852 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.core.snapshots.TestSolrCloudSnapshots_DCDBCA01B1997D58-001/tempDir-001
   [junit4]   2> 1898852 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1898853 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1898853 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1898853 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1898953 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 40877
   [junit4]   2> 1898953 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:40877
   [junit4]   2> 1898953 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40877
   [junit4]   2> 1898953 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40877
   [junit4]   2> 1898955 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1898956 INFO  (zkConnectionManagerCallback-21081-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1898957 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1898959 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1898960 INFO  (zkConnectionManagerCallback-21083-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1898960 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1898960 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1898962 INFO  (zkConnectionManagerCallback-21085-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1898962 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1899067 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1899068 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1899068 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1899068 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1899078 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1899078 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1899078 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1899078 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@52f2837a{/solr,null,AVAILABLE}
   [junit4]   2> 1899079 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1899079 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1899079 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1899079 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c5ac474{/solr,null,AVAILABLE}
   [junit4]   2> 1899079 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3061aacc{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:45053}
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.e.j.s.Server Started @1899158ms
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40877/solr, hostPort=45053}
   [junit4]   2> 1899080 ERROR (jetty-launcher-21086-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T10:28:49.924Z
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1899080 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@43bac210{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:37265}
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.e.j.s.Server Started @1899160ms
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40877/solr, hostPort=37265}
   [junit4]   2> 1899082 ERROR (jetty-launcher-21086-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1899082 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T10:28:49.926Z
   [junit4]   2> 1899083 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1899083 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1899083 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1899086 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1899086 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b250fc1{/solr,null,AVAILABLE}
   [junit4]   2> 1899086 INFO  (jetty-launcher-21086-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47573e22{/solr,null,AVAILABLE}
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@53814274{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:37903}
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.e.j.s.Server Started @1899165ms
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40877/solr, hostPort=37903}
   [junit4]   2> 1899087 ERROR (jetty-launcher-21086-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1899087 INFO  (zkConnectionManagerCallback-21090-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@6c685b48{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:43147}
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.e.j.s.Server Started @1899165ms
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T10:28:49.931Z
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:40877/solr, hostPort=43147}
   [junit4]   2> 1899087 ERROR (jetty-launcher-21086-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1899087 INFO  (jetty-launcher-21086-

[...truncated too long message...]

 while closing send thread for session 0x1038a82b2d70000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038a82b2d70000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038a82b2d70000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1910083 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/collections/SolrCloudSnapshots/terms/shard2
   [junit4]   2> 	7	/solr/collections/SolrCloudSnapshots/terms/shard1
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/collections/SolrCloudSnapshots/collectionprops.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	72	/solr/collections/SolrCloudSnapshots/state.json
   [junit4]   2> 	7	/solr/collections/SolrCloudSnapshots/collectionprops.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	33	/solr/overseer/queue
   [junit4]   2> 	20	/solr/live_nodes
   [junit4]   2> 	17	/solr/collections/SolrCloudSnapshots/state.json
   [junit4]   2> 	12	/solr/overseer/collection-queue-work
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	2	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1910086 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:40877
   [junit4]   2> 1910086 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40877
   [junit4]   2> 1910086 INFO  (SUITE-TestSolrCloudSnapshots-seed#[DCDBCA01B1997D58]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40877
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.core.snapshots.TestSolrCloudSnapshots_DCDBCA01B1997D58-001
   [junit4]   2> Feb 24, 2021 10:29:01 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=SimpleText, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=hr, timezone=Asia/Bahrain
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=199447080,total=526909440
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemaField, TestRemoteStreaming, BitVectorTest, TestSolrIndexConfig, UpdateParamsTest, TestSolr4Spatial, TestSystemIdResolver, TestChildDocTransformer, LocalFSCloudIncrementalBackupTest, OutputWriterTest, TestImplicitCoreProperties, TestLegacyTerms, JWTVerificationkeyResolverTest, TermVectorComponentTest, MetricsHistoryIntegrationTest, TestTolerantUpdateProcessorCloud, CustomHighlightComponentTest, LeaderElectionContextKeyTest, TestDistributedTracing, SuggesterWFSTTest, DistributedExpandComponentTest, TestReqParamsAPI, TestSimpleTrackingShardHandler, TestFastLRUCache, TestAuthorizationFramework, MoreLikeThisComponentTest, PingRequestHandlerTest, TestFileDictionaryLookup, UpdateRequestProcessorFactoryTest, UtilsToolTest, TestCloudJSONFacetSKG, AuditLoggerIntegrationTest, CollectionTooManyReplicasTest, DeleteNodeTest, HdfsBasicDistributedZk2Test, DistributedUpdateProcessorTest, SolrSlf4jReporterTest, TestNoOpRegenerator, TestCloudPivotFacet, TestHttpShardHandlerFactory, ReturnFieldsTest, TestGraphMLResponseWriter, DocValuesTest, HdfsNNFailoverTest, TestTrieFacet, TestDFISimilarityFactory, FileUtilsTest, DOMUtilTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestLMJelinekMercerSimilarityFactory, TestMacroExpander, OverseerSolrResponseTest, SegmentsInfoRequestHandlerTest, TestSolrCoreSnapshots, ResponseHeaderTest, TestInitQParser, TestStandardQParsers, OverseerTest, TestNumericTokenStream, PreAnalyzedUpdateProcessorTest, MoveReplicaHDFSFailoverTest, TestManagedSynonymFilterFactory, TestRawResponseWriter, TestDistribIDF, TestBinaryField, MultiThreadedOCPTest, TestConfig, TriggerCooldownIntegrationTest, DistributedFacetPivotSmallAdvancedTest, TestManagedSchemaAPI, CdcrUpdateLogTest, HdfsDirectoryFactoryTest, TestRTimerTree, TestPhraseSuggestions, TestPullReplica, TestConfigSets, QueryEqualityTest, TaggerTest, TestPseudoReturnFields, TestSimTriggerIntegration, ConcurrentDeleteAndCreateCollectionTest, TestCloudConsistency, DistributedQueryComponentCustomSortTest, ClassificationUpdateProcessorTest, MaxSizeAutoCommitTest, TestSimpleTextCodec, InfoHandlerTest, GraphQueryTest, OpenExchangeRatesOrgProviderTest, AliasIntegrationTest, TestDelegationWithHadoopAuth, TestRandomRequestDistribution, SliceStateTest, TestFieldCacheVsDocValues, TestLockTree, TestIncrementalCoreBackup, TestDistribDocBasedVersion, WordBreakSolrSpellCheckerTest, UninvertDocValuesMergePolicyTest, DirectSolrSpellCheckerTest, TestWithCollection, TestCollationField, HdfsSyncSliceTest, TestCSVLoader, TestFoldingMultitermQuery, SpatialFilterTest, TestBinaryResponseWriter, TestExportTool, TestOrdValues, ZkFailoverTest, RecoveryZkTest, CoreSorterTest, BooleanFieldTest, CdcrBidirectionalTest, SolrMetricsIntegrationTest, AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, CursorPagingTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, SolrInfoBeanTest, SolrTestCaseJ4DeleteCoreTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestDistributedMissingSort, TestDistributedSearch, TestDocumentBuilder, TestGroupingSearch, TestHighlightDedupGrouping, TestJoin, TestTolerantSearch, TestTrie, PathHierarchyTokenizerFactoryTest, ProtectedTermFilterFactoryTest, TestLuceneMatchVersion, TestReversedWildcardFilterFactory, TestWordDelimiterFilterFactory, TokenizerChainTest, TestLuceneIndexBackCompat, BasicDistributedZkTest, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, HttpPartitionOnCommitTest, MigrateRouteKeyTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, RemoteQueryErrorTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, RouteFieldTest, RoutingToNodesWithPropertiesTest, ShardRoutingTest, SyncSliceTest, TestLeaderElectionWithEmptyReplica, TestSolrCloudWithKerberosAlt, TestUtilizeNode, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, UnloadDistributedZkTest, TestCollectionAPI, ComputePlanActionTest, NodeLostTriggerIntegrationTest, ScheduledMaintenanceTriggerTest, ZkStateReaderTest, ZkStateWriterTest, ConfigureRecoveryStrategyTest, DirectoryFactoryTest, ResourceLoaderTest, TestBackupRepositoryFactory, TestBadConfig, TestCoreDiscovery, TestDynamicURP, TestQuerySenderListener, TestQuerySenderNoQuery, TestSolrDeletionPolicy1, TestXIncludeConfig, TestSolrCloudSnapshots]
   [junit4] Completed [663/934 (2!)] on J0 in 11.98s, 1 test, 1 error <<< FAILURES!

[...truncated 51673 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1634 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1634/

1 tests failed.
FAILED:  org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery

Error Message:
Expected a collection with one shard and two replicas Timeout waiting to see state for collection=MissingSegmentRecoveryTest :DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/6 )={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"MissingSegmentRecoveryTest_shard1_replica_n1",           "node_name":"127.0.0.1:39051_solr",           "base_url":"https://127.0.0.1:39051/solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"},         "core_node4":{           "core":"MissingSegmentRecoveryTest_shard1_replica_n2",           "node_name":"127.0.0.1:33031_solr",           "base_url":"https://127.0.0.1:33031/solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"} Live Nodes: [127.0.0.1:33031_solr, 127.0.0.1:39051_solr] Last available state: DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/6 )={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"MissingSegmentRecoveryTest_shard1_replica_n1",           "node_name":"127.0.0.1:39051_solr",           "base_url":"https://127.0.0.1:39051/solr",           "state":"active",           "type":"NRT",           "force_set_state":"false",           "leader":"true"},         "core_node4":{           "core":"MissingSegmentRecoveryTest_shard1_replica_n2",           "node_name":"127.0.0.1:33031_solr",           "base_url":"https://127.0.0.1:33031/solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Expected a collection with one shard and two replicas
Timeout waiting to see state for collection=MissingSegmentRecoveryTest :DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/6 )={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"MissingSegmentRecoveryTest_shard1_replica_n1",
          "node_name":"127.0.0.1:39051_solr",
          "base_url":"https://127.0.0.1:39051/solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node4":{
          "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
          "node_name":"127.0.0.1:33031_solr",
          "base_url":"https://127.0.0.1:33031/solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
Live Nodes: [127.0.0.1:33031_solr, 127.0.0.1:39051_solr]
Last available state: DocCollection(MissingSegmentRecoveryTest//collections/MissingSegmentRecoveryTest/state.json/6 )={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"MissingSegmentRecoveryTest_shard1_replica_n1",
          "node_name":"127.0.0.1:39051_solr",
          "base_url":"https://127.0.0.1:39051/solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node4":{
          "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
          "node_name":"127.0.0.1:33031_solr",
          "base_url":"https://127.0.0.1:33031/solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([6AAB90920BC6BE58:3AFE089152E70845]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:336)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:313)
	at org.apache.solr.cloud.MissingSegmentRecoveryTest.testLeaderRecovery(MissingSegmentRecoveryTest.java:110)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14990 lines...]
   [junit4] Suite: org.apache.solr.cloud.MissingSegmentRecoveryTest
   [junit4]   2> 1266128 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1266128 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/data-dir-138-001
   [junit4]   2> 1266128 WARN  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=102 numCloses=102
   [junit4]   2> 1266128 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1266130 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1266130 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1266131 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001
   [junit4]   2> 1266131 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1266131 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1266131 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1266132 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1266231 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 36903
   [junit4]   2> 1266231 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:36903
   [junit4]   2> 1266231 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:36903
   [junit4]   2> 1266231 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 36903
   [junit4]   2> 1266233 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266237 INFO  (zkConnectionManagerCallback-10829-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266237 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266243 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266244 INFO  (zkConnectionManagerCallback-10831-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266244 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266245 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266245 INFO  (zkConnectionManagerCallback-10833-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266245 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266247 WARN  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1266351 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1266352 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1266352 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1266352 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1266352 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e086164{/solr,null,AVAILABLE}
   [junit4]   2> 1266354 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1266354 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1266354 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1266357 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42b1d454{/solr,null,AVAILABLE}
   [junit4]   2> 1266358 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@73e627c0{SSL, (ssl, http/1.1)}{127.0.0.1:39051}
   [junit4]   2> 1266358 INFO  (jetty-launcher-10834-thread-2) [     ] o.e.j.s.Server Started @1266387ms
   [junit4]   2> 1266358 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:36903/solr, hostPort=39051}
   [junit4]   2> 1266358 ERROR (jetty-launcher-10834-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1266358 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1266359 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1266359 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1266359 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1266359 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T01:28:17.528Z
   [junit4]   2> 1266360 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266360 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@25ef9ead{SSL, (ssl, http/1.1)}{127.0.0.1:33031}
   [junit4]   2> 1266360 INFO  (jetty-launcher-10834-thread-1) [     ] o.e.j.s.Server Started @1266389ms
   [junit4]   2> 1266360 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:36903/solr, hostPort=33031}
   [junit4]   2> 1266361 ERROR (jetty-launcher-10834-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1266361 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1266361 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1266361 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1266361 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1266361 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T01:28:17.530Z
   [junit4]   2> 1266365 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266365 INFO  (zkConnectionManagerCallback-10836-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266365 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266366 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1266366 INFO  (zkConnectionManagerCallback-10838-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266366 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266369 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1266370 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1266371 WARN  (jetty-launcher-10834-thread-2-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1266373 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1266672 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1266673 WARN  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1266673 WARN  (jetty-launcher-10834-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@634fef19[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1266673 WARN  (jetty-launcher-10834-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@634fef19[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1266675 WARN  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1266676 WARN  (jetty-launcher-10834-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@686174a3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1266676 WARN  (jetty-launcher-10834-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@686174a3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1266677 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36903/solr
   [junit4]   2> 1266678 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266679 INFO  (zkConnectionManagerCallback-10852-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266679 INFO  (jetty-launcher-10834-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266680 WARN  (jetty-launcher-10834-thread-2-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1266818 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1266821 INFO  (zkConnectionManagerCallback-10854-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1266821 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1266906 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39051_solr
   [junit4]   2> 1266906 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.Overseer Overseer (id=73052187430944774-127.0.0.1:39051_solr-n_0000000000) starting
   [junit4]   2> 1266912 INFO  (OverseerStateUpdate-73052187430944774-127.0.0.1:39051_solr-n_0000000000) [n:127.0.0.1:39051_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:39051_solr
   [junit4]   2> 1266912 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39051_solr
   [junit4]   2> 1266916 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1266916 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1266916 WARN  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1266941 INFO  (jetty-launcher-10834-thread-2) [n:127.0.0.1:39051_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node2
   [junit4]   2> 1267153 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1267153 WARN  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1267160 WARN  (jetty-launcher-10834-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7e60033[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1267160 WARN  (jetty-launcher-10834-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7e60033[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1267163 WARN  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1267169 WARN  (jetty-launcher-10834-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5ffdbf65[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1267169 WARN  (jetty-launcher-10834-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5ffdbf65[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1267171 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36903/solr
   [junit4]   2> 1267204 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1267207 INFO  (zkConnectionManagerCallback-10872-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1267207 INFO  (jetty-launcher-10834-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1267333 WARN  (jetty-launcher-10834-thread-1-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30007.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1267438 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1267440 INFO  (zkConnectionManagerCallback-10874-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1267440 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1267450 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1267454 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:33031_solr as DOWN
   [junit4]   2> 1267455 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1267455 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33031_solr
   [junit4]   2> 1267462 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1267463 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1267463 WARN  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1267465 INFO  (zkCallback-10873-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1267475 INFO  (jetty-launcher-10834-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1
   [junit4]   2> 1267482 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1267483 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1267485 INFO  (zkConnectionManagerCallback-10885-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1267485 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1267488 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1267490 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36903/solr ready
   [junit4]   2> 1267518 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testLeaderRecovery
   [junit4]   2> 1267558 INFO  (OverseerThreadFactory-10861-thread-1-processing-n:127.0.0.1:39051_solr) [n:127.0.0.1:39051_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection MissingSegmentRecoveryTest
   [junit4]   2> 1267676 INFO  (OverseerStateUpdate-73052187430944774-127.0.0.1:39051_solr-n_0000000000) [n:127.0.0.1:39051_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"MissingSegmentRecoveryTest_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:39051_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:39051/solr",
   [junit4]   2>   "collection":"MissingSegmentRecoveryTest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1267678 INFO  (OverseerStateUpdate-73052187430944774-127.0.0.1:39051_solr-n_0000000000) [n:127.0.0.1:39051_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"MissingSegmentRecoveryTest_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:33031_solr",
   [junit4]   2>   "base_url":"https://127.0.0.1:33031/solr",
   [junit4]   2>   "collection":"MissingSegmentRecoveryTest",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1267894 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr    x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1267895 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr    x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1267921 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1267941 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr    x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1267948 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1267948 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1267949 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n1' using configuration from configset conf, trusted=true
   [junit4]   2> 1267949 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore [[MissingSegmentRecoveryTest_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node2/MissingSegmentRecoveryTest_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node2/MissingSegmentRecoveryTest_shard1_replica_n1/data/]
   [junit4]   2> 1267953 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1267962 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1267962 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1267962 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n2' using configuration from configset conf, trusted=true
   [junit4]   2> 1267963 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore [[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/]
   [junit4]   2> 1268003 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1268003 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1268004 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1268004 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1268006 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1268006 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1268008 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1268008 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1268008 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1268008 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1268008 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1268008 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692538082874621952
   [junit4]   2> 1268010 INFO  (searcherExecutor-10887-thread-1-processing-n:127.0.0.1:39051_solr x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest s:shard1 r:core_node3) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1268011 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1268011 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1268011 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1268012 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692538082878816256
   [junit4]   2> 1268017 INFO  (searcherExecutor-10889-thread-1-processing-n:127.0.0.1:33031_solr x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest s:shard1 r:core_node4) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1268023 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MissingSegmentRecoveryTest/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1268023 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/MissingSegmentRecoveryTest/leaders/shard1
   [junit4]   2> 1268025 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MissingSegmentRecoveryTest/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1268026 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/MissingSegmentRecoveryTest/leaders/shard1
   [junit4]   2> 1268028 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1268028 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1268028 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39051/solr/MissingSegmentRecoveryTest_shard1_replica_n1/
   [junit4]   2> 1268029 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=MissingSegmentRecoveryTest_shard1_replica_n1 url=https://127.0.0.1:39051/solr  START replicas=[https://127.0.0.1:33031/solr/MissingSegmentRecoveryTest_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1268029 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=MissingSegmentRecoveryTest_shard1_replica_n1 url=https://127.0.0.1:39051/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1268042 INFO  (qtp790099421-18491) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.S.Request [MissingSegmentRecoveryTest_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 1268043 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1268043 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1268043 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/MissingSegmentRecoveryTest/leaders/shard1/leader after winning as /collections/MissingSegmentRecoveryTest/leader_elect/shard1/election/73052187430944774-core_node3-n_0000000000
   [junit4]   2> 1268046 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39051/solr/MissingSegmentRecoveryTest_shard1_replica_n1/ shard1
   [junit4]   2> 1268148 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268149 INFO  (zkCallback-10853-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268149 INFO  (zkCallback-10853-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268153 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1268158 INFO  (qtp2032028848-18481) [n:127.0.0.1:39051_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n1&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=264
   [junit4]   2> 1268257 INFO  (zkCallback-10853-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268257 INFO  (zkCallback-10853-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268257 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1268258 INFO  (zkCallback-10853-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269036 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=MissingSegmentRecoveryTest_shard1_replica_n2&action=CREATE&numShards=1&collection=MissingSegmentRecoveryTest&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1098
   [junit4]   2> 1269039 INFO  (qtp2032028848-18478) [n:127.0.0.1:39051_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1269135 INFO  (zkCallback-10873-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269135 INFO  (zkCallback-10853-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269135 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269135 INFO  (zkCallback-10853-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269135 INFO  (zkCallback-10873-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269135 INFO  (zkCallback-10853-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1269136 INFO  (qtp2032028848-18478) [n:127.0.0.1:39051_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=1&name=MissingSegmentRecoveryTest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1586
   [junit4]   2> 1269136 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.SolrCloudTestCase waitForState (MissingSegmentRecoveryTest): Expected a collection with one shard and two replicas
   [junit4]   2> 1269138 INFO  (watches-10882-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 1269138 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 1269139 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 1269139 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 2 expected replica count: 2
   [junit4]   2> 1269146 INFO  (qtp2032028848-18482) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MissingSegmentRecoveryTest/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
   [junit4]   2> 1269188 INFO  (qtp790099421-18491) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [MissingSegmentRecoveryTest_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:39051/solr/MissingSegmentRecoveryTest_shard1_replica_n1/&wt=javabin&version=2}{add=[0 (1692538084064755712), 1 (1692538084066852864), 2 (1692538084066852865), 3 (1692538084067901440), 4 (1692538084067901441), 5 (1692538084067901442), 6 (1692538084067901443), 7 (1692538084067901444), 8 (1692538084067901445), 9 (1692538084067901446)]} 0 3
   [junit4]   2> 1269189 INFO  (qtp2032028848-18482) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [MissingSegmentRecoveryTest_shard1_replica_n1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0 (1692538084064755712), 1 (1692538084066852864), 2 (1692538084066852865), 3 (1692538084067901440), 4 (1692538084067901441), 5 (1692538084067901442), 6 (1692538084067901443), 7 (1692538084067901444), 8 (1692538084067901445), 9 (1692538084067901446)]} 0 47
   [junit4]   2> 1269253 INFO  (searcherExecutor-10887-thread-1-processing-n:127.0.0.1:39051_solr x:MissingSegmentRecoveryTest_shard1_replica_n1 c:MissingSegmentRecoveryTest s:shard1 r:core_node3) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1269253 INFO  (searcherExecutor-10889-thread-1-processing-n:127.0.0.1:33031_solr x:MissingSegmentRecoveryTest_shard1_replica_n2 c:MissingSegmentRecoveryTest s:shard1 r:core_node4) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1269254 INFO  (qtp790099421-18490) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [MissingSegmentRecoveryTest_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:39051/solr/MissingSegmentRecoveryTest_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 60
   [junit4]   2> 1269255 INFO  (qtp2032028848-18479) [n:127.0.0.1:39051_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node3 x:MissingSegmentRecoveryTest_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [MissingSegmentRecoveryTest_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=MissingSegmentRecoveryTest:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 65
   [junit4]   2> 1269257 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1151521147
   [junit4]   2> 1269257 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33031_solr
   [junit4]   2> 1269258 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1269258 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:33031_solr as DOWN
   [junit4]   2> 1269261 INFO  (coreCloseExecutor-10901-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@23f8c790
   [junit4]   2> 1269261 INFO  (coreCloseExecutor-10901-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.MissingSegmentRecoveryTest.shard1.replica_n2 tag=SolrCore@23f8c790
   [junit4]   2> 1269261 INFO  (coreCloseExecutor-10901-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.MissingSegmentRecoveryTest.shard1.leader tag=SolrCore@23f8c790
   [junit4]   2> 1269262 INFO  (coreCloseExecutor-10901-thread-1) [n:127.0.0.1:33031_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1269263 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1269263 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1269263 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1269264 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1269266 WARN  (jetty-launcher-10834-thread-1-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1269266 INFO  (zkCallback-10853-thread-4) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1269269 INFO  (zkCallback-10884-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1269361 INFO  (zkCallback-10853-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1269361 INFO  (zkCallback-10853-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1269361 INFO  (zkCallback-10853-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1269361 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1269369 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@25ef9ead{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1269370 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@42b1d454{/solr,null,STOPPED}
   [junit4]   2> 1269370 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1269370 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=33031)
   [junit4]   2> 1269372 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 33031 try number 2 ...
   [junit4]   2> 1269372 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1269372 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1269372 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1269372 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1269373 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29705701{/solr,null,AVAILABLE}
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@62d5116a{SSL, (ssl, http/1.1)}{127.0.0.1:33031}
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.s.Server Started @1269403ms
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:36903/solr, hostPort=33031}
   [junit4]   2> 1269375 ERROR (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.9.0
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1269375 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-24T01:28:20.544Z
   [junit4]   2> 1269376 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269376 INFO  (zkConnectionManagerCallback-10905-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1269377 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1269377 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1269381 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1269560 INFO  (OverseerCollectionConfigSetProcessor-73052187430944774-127.0.0.1:39051_solr-n_0000000000) [n:127.0.0.1:39051_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1269876 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1269877 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1269877 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@151156cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1269877 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@151156cf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1269880 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 1269881 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@175feaaa[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1269881 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@175feaaa[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1269882 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36903/solr
   [junit4]   2> 1269883 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269884 INFO  (zkConnectionManagerCallback-10916-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1269884 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1269989 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269990 INFO  (zkConnectionManagerCallback-10918-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1269990 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1269998 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1270002 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:33031_solr as DOWN
   [junit4]   2> 1270003 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1270003 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33031_solr
   [junit4]   2> 1270004 INFO  (zkCallback-10853-thread-5) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1270004 INFO  (zkCallback-10884-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1270006 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1270007 WARN  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1270009 INFO  (zkCallback-10917-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1270024 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1
   [junit4]   2> 1270024 INFO  (TEST-MissingSegmentRecoveryTest.testLeaderRecovery-seed#[6AAB90920BC6BE58]) [n:127.0.0.1:33031_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [MissingSegmentRecoveryTest_shard1_replica_n2]
   [junit4]   2> 1270039 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1270066 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1270066 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1270083 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1270093 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1270094 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1270094 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'MissingSegmentRecoveryTest_shard1_replica_n2' using configuration from configset conf, trusted=true
   [junit4]   2> 1270094 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.c.SolrCore [[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/]
   [junit4]   2> 1270105 INFO  (zkCallback-10853-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1270105 INFO  (zkCallback-10853-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1270105 INFO  (zkCallback-10853-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1270105 INFO  (zkCallback-10853-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/MissingSegmentRecoveryTest/state.json] for collection [MissingSegmentRecoveryTest] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1270147 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1270147 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1270149 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1270149 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr c:MissingSegmentRecoveryTest s:shard1 r:core_node4 x:MissingSegmentRecoveryTest_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1270152 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.SolrCore [MissingSegmentRecoveryTest_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@d7b7ece
   [junit4]   2> 1270152 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.MissingSegmentRecoveryTest.shard1.replica_n2 tag=SolrCore@d7b7ece
   [junit4]   2> 1270152 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.MissingSegmentRecoveryTest.shard1.leader tag=SolrCore@d7b7ece
   [junit4]   2> 1270152 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1270164 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.CoreContainer Found active leader, will attempt to create fresh core and recover.
   [junit4]   2> 1270164 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.SolrCore Updating index properties... index=index.20210224075821333
   [junit4]   2> 1270171 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/MissingSegmentRecoveryTest/terms/shard1 to Terms{values={core_node3=1, core_node4=0}, version=3}
   [junit4]   2> 1270172 INFO  (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.c.SolrCore [[MissingSegmentRecoveryTest_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/]
   [junit4]   2> 1270175 INFO  (OldIndexDirectoryCleanupThreadForCore-MissingSegmentRecoveryTest_shard1_replica_n2) [     ] o.a.s.c.DirectoryFactory Found 1 old index directories to clean-up under /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/ afterReload=false
   [junit4]   2> 1270180 INFO  (OldIndexDirectoryCleanupThreadForCore-MissingSegmentRecoveryTest_shard1_replica_n2) [     ] o.a.s.c.DirectoryFactory Deleted old index directory: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/index.20210224075821333
   [junit4]   2> 1270181 ERROR (coreLoadExecutor-10924-thread-1-processing-n:127.0.0.1:33031_solr) [n:127.0.0.1:33031_solr     ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/index.20210224075821333/write.lock
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
   [junit4]   2> java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/index.20210224075821333/write.lock
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144) ~[?:?]
   [junit4]   2> 	at sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99) ~[?:?]
   [junit4]   2> 	at java.nio.file.Files.readAttributes(Files.java:1737) ~[?:1.8.0_281]
   [junit4]   2> 	at org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:189) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.store.LockValidatingDirectoryWrapper.sync(LockValidatingDirectoryWrapper.java:67) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:5101) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3460) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3770) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1237) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.common.util.IOUtils.closeQuietly(IOUtils.java:31) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:816) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1003) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:921) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.processCoreCreateException(CoreContainer.java:1520) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1433) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.lambda$load$11(CoreContainer.java:856) ~[java/:?]
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) ~[metrics-core-4.1.5.jar:4.1.5]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_281]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:218) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_281]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_281]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> 	Suppressed: java.nio.file.NoSuchFileException: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001/tempDir-001/node1/MissingSegmentRecoveryTest_shard1_replica_n2/data/index.20210224075821333
   [junit4]   2> 		at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:?]
   [junit4]   2> 		at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
   [junit4]   2> 		at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
   [junit4]   2> 		at sun.nio.fs.UnixFileSystemProvider.newDirectoryStream(UnixFileSystemProvider.java:427) ~[?:?]
   [junit4]   2> 		at java.nio.file.Files.newDirectoryStream(Files.java:457) ~[?:1.8.0_281]
   [junit4]   2> 		at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:214) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:233) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.store.FilterDirectory.listAll(FilterDirectory.java:58) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:427) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2473) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2409) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1241) ~[java/:?]
   [junit4]   2> 		at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.common.util.IOUtils.closeQuietly(IOUtils.java:31) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:816) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1003) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.SolrCore.<init>(SolrCore.java:921) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.CoreContainer.processCoreCreateException(CoreContainer.java:1520) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1433) ~[java/:?]
   [junit4]   2> 		at org.apache.solr.core.CoreContainer.lambda$load$11(CoreContainer.java:856) ~[java/:?]
   [junit4]   2> 		at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:202) ~[metrics-core-4.1.5.jar:4.1.5]
   [junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_281]
   [junit4]   2> 		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:218) ~[java/:?]
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_281]
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_281]
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:748) 

[...truncated too long message...]

unit4]   2> 1315752 INFO  (jetty-closer-10937-thread-2-processing-n:127.0.0.1:33031_solr) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1315755 INFO  (jetty-closer-10937-thread-1-processing-n:127.0.0.1:33031_solr) [     ] o.a.s.c.Overseer Overseer (id=73052187430944774-127.0.0.1:39051_solr-n_0000000000) closing
   [junit4]   2> 1315755 INFO  (jetty-closer-10937-thread-1-processing-n:127.0.0.1:33031_solr) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@73e627c0{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 1315756 INFO  (jetty-closer-10937-thread-1-processing-n:127.0.0.1:33031_solr) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1e086164{/solr,null,STOPPED}
   [junit4]   2> 1315756 INFO  (jetty-closer-10937-thread-1-processing-n:127.0.0.1:33031_solr) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1315758 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1315759 WARN  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker-SendThread(127.0.0.1:36903)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x1038893d1e30000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x1038893d1e30000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1315961 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	13	/solr/collections/MissingSegmentRecoveryTest/terms/shard1
   [junit4]   2> 	5	/solr/collections/MissingSegmentRecoveryTest/state.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	2	/solr/configs/conf
   [junit4]   2> 	2	/solr/collections/MissingSegmentRecoveryTest/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	37	/solr/collections/MissingSegmentRecoveryTest/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/73052187430944774-127.0.0.1:39051_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	27	/solr/overseer/queue
   [junit4]   2> 	12	/solr/live_nodes
   [junit4]   2> 	12	/solr/collections/MissingSegmentRecoveryTest/state.json
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	7	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1315963 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:36903
   [junit4]   2> 1315963 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:36903
   [junit4]   2> 1315963 INFO  (SUITE-MissingSegmentRecoveryTest-seed#[6AAB90920BC6BE58]-worker) [n:127.0.0.1:33031_solr     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 36903
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J3/temp/solr.cloud.MissingSegmentRecoveryTest_6AAB90920BC6BE58-001
   [junit4]   2> Feb 24, 2021 1:29:07 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {_root_=FST50, id=Lucene84}, docValues:{_version_=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1868, maxMBSortInHeap=6.421859296681155, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=es-PE, timezone=Asia/Yangon
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=228762136,total=521666560
   [junit4]   2> NOTE: All tests run in this JVM: [SolrLogAuditLoggerPluginTest, NoCacheHeaderTest, ScheduledTriggerTest, DistributedFacetPivotLongTailTest, TestNRTOpen, LegacyCloudClusterPropTest, TestZkAclsWithHadoopAuth, ReplaceNodeNoTargetTest, TestManagedResourceStorage, NodeMarkersRegistrationTest, TestSQLHandlerNonCloud, SolrTestCaseJ4DeleteCoreTest, ScriptEngineTest, TestSmileRequest, AutoAddReplicasIntegrationTest, TestComponentsName, DeleteLastCustomShardedReplicaTest, TestAuthenticationFramework, TestTermsQParserPlugin, NodeAddedTriggerIntegrationTest, TestSimScenario, V2CollectionBackupsAPIMappingTest, SolrRrdBackendFactoryTest, SynonymTokenizerTest, TestExtendedDismaxParser, TestManagedSchema, TestSubQueryTransformer, TestRealTimeGet, TestConfigSetsAPIExclusivity, CoreAdminRequestStatusTest, TimeZoneUtilsTest, AddReplicaTest, MinimalSchemaTest, NumericFieldsTest, SolrCoreCheckLockOnStartupTest, TestLRUStatsCache, DistributedQueueTest, TestObjectReleaseTracker, HdfsChaosMonkeySafeLeaderTest, CloudMLTQParserTest, SchemaApiFailureTest, TestCloudRecovery2, TestHdfsBackupRestoreCore, TestRandomFlRTGCloud, TestCloudPhrasesIdentificationComponent, TestScoreJoinQPNoScore, CursorPagingTest, TestTrie, TemplateUpdateProcessorTest, LeaderFailoverAfterPartitionTest, CollectionPropsTest, TestDistributedGrouping, HighlighterWithoutStoredIdTest, TimeRoutedAliasUpdateProcessorTest, SuggesterTest, TestIndexingPerformance, TestClassicSimilarityFactory, BigEndianAscendingWordSerializerTest, TestSkipOverseerOperations, IndexSizeTriggerSizeEstimationTest, TestFieldTypeCollectionResource, TestDynamicFieldCollectionResource, CSVRequestHandlerTest, TestPayloadScoreQParserPlugin, TestSort, TestStressIncrementalBackup, TestCloudSchemaless, TestTlogReplica, TestManagedStopFilterFactory, SolrIndexSplitterTest, TestLeaderElectionZkExpiry, TestSha256AuthenticationProvider, DocumentBuilderTest, TestExpandComponent, SolrMetricReporterTest, IndexSchemaRuntimeFieldTest, TestSolrDeletionPolicy2, TestStressCloudBlindAtomicUpdates, TestSimDistributedQueue, CrossCollectionJoinQueryTest, SpellCheckCollatorTest, RecoveryAfterSoftCommitTest, SaslZkACLProviderTest, TestShardHandlerFactory, TestSSLRandomization, DocValuesMultiTest, TestIndexSearcher, SecurityConfHandlerTest, BasicDistributedZkTest, AtomicUpdateProcessorFactoryTest, TestReloadDeadlock, PreAnalyzedFieldTest, CurrencyFieldTypeTest, SolrJmxReporterTest, TokenizerChainTest, ConjunctionSolrSpellCheckerTest, DimensionalRoutedAliasUpdateProcessorTest, CollectionReloadTest, SpellCheckComponentTest, HttpPartitionWithTlogReplicasTest, SolrXmlInZkTest, TestDynamicFieldNamesIndexCorrectly, TestFieldCacheSortRandom, RankQueryTest, BlobRepositoryCloudTest, MBeansHandlerTest, DistributedMLTComponentTest, PeerSyncWithIndexFingerprintCachingTest, TestPushWriter, TriLevelCompositeIdRoutingTest, TestHdfsCloudBackupRestore, ZkControllerTest, TestSlowCompositeReaderWrapper, TestPolicyCloud, ChaosMonkeySafeLeaderTest, DeleteNodeTest, DeleteStatusTest, DistributedVersionInfoTest, MissingSegmentRecoveryTest]
   [junit4] Completed [515/934 (1!)] on J3 in 50.58s, 1 test, 1 failure <<< FAILURES!

[...truncated 52186 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1633 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1633/

All tests passed

Build Log:
[...truncated 67151 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1632 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1632/

1 tests failed.
FAILED:  org.apache.solr.handler.component.DistributedExpandComponentTest.test

Error Message:
Error from server at https://127.0.0.1:46043/collection1: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46043/collection1: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero
	at __randomizedtesting.SeedInfo.seed([B418D26D05E3D811:3C4CEDB7AB1FB5E9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1003)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1018)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:625)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:677)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:655)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:634)
	at org.apache.solr.handler.component.DistributedExpandComponentTest._test(DistributedExpandComponentTest.java:94)
	at org.apache.solr.handler.component.DistributedExpandComponentTest.test(DistributedExpandComponentTest.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13266 lines...]
   [junit4] Suite: org.apache.solr.handler.component.DistributedExpandComponentTest
   [junit4]   2> 17396 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 17397 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/data-dir-3-001
   [junit4]   2> 17397 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=22 numCloses=22
   [junit4]   2> 17397 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 17399 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 17415 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 17416 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 17416 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 17424 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 17440 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 17465 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 17481 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.D.s.EnumField Solr loaded a deprecated plugin/analysis class [solr.EnumField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 17499 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 18358 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 18360 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 18371 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5866b426[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 18371 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5866b426[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 18395 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 18400 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@13267e2f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 18400 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@13267e2f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 18402 WARN  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 18429 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 18436 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 18437 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 18452 INFO  (coreLoadExecutor-55-thread-1) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 18460 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 18475 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 18492 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 18500 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 18505 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 18505 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 18505 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/data-dir-3-001/]
   [junit4]   2> 18508 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44923680024500834]
   [junit4]   2> 18969 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 18969 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 18987 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 18987 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 18999 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=27.8359375, floorSegmentMB=0.9189453125, forceMergeDeletesPctAllowed=2.2111407928130444, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.68051544221077
   [junit4]   2> 19365 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 19367 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 19415 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=a_s,minQueryLength=3}
   [junit4]   2> 19426 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 19639 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 19640 INFO  (coreLoadExecutor-55-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692506853042290688
   [junit4]   2> 19642 INFO  (searcherExecutor-57-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 19644 INFO  (searcherExecutor-57-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 19645 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 20074 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/cores/collection1
   [junit4]   2> 20082 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 20082 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 20082 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 20152 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 20152 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 20152 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 20168 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@27c0a7c2{/,null,AVAILABLE}
   [junit4]   2> 20174 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@87abe4f{SSL, (ssl, http/1.1)}{127.0.0.1:36101}
   [junit4]   2> 20174 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server Started @20219ms
   [junit4]   2> 20174 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema11.xml, solrconfig=solrconfig-collapseqparser.xml, hostContext=/, hostPort=36101, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/cores}
   [junit4]   2> 20175 ERROR (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T17:11:56.623Z
   [junit4]   2> 20175 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/solr.xml
   [junit4]   2> 20178 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 20178 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 20180 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 21784 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 21785 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 21786 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7617a81b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 21786 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7617a81b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 21793 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 21796 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@405a9f3c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 21797 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@405a9f3c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 21798 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 21816 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 21816 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 21837 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 21844 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 21845 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 21847 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/cores
   [junit4]   2> 21847 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 21858 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 21873 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 21893 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 21905 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 21914 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 21915 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 21916 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/cores/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/control/cores/collection1/data/]
   [junit4]   2> 21919 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44923680024500834]
   [junit4]   2> 21990 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 21991 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 21993 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 21993 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 21994 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=27.8359375, floorSegmentMB=0.9189453125, forceMergeDeletesPctAllowed=2.2111407928130444, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.68051544221077
   [junit4]   2> 21996 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 21996 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 21996 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=a_s,minQueryLength=3}
   [junit4]   2> 21997 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 22001 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 22001 INFO  (coreLoadExecutor-75-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692506855517978624
   [junit4]   2> 22002 INFO  (searcherExecutor-77-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 22005 INFO  (searcherExecutor-77-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 22625 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 22627 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 22627 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 22627 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 22645 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 22645 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 22646 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 22648 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d79f5a6{/,null,AVAILABLE}
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@33878858{SSL, (ssl, http/1.1)}{127.0.0.1:37969}
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server Started @22698ms
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema11.xml, solrconfig=solrconfig-collapseqparser.xml, hostContext=/, hostPort=37969, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/cores}
   [junit4]   2> 22653 ERROR (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T17:11:59.101Z
   [junit4]   2> 22653 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/solr.xml
   [junit4]   2> 22656 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 22656 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 22658 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 23061 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 23063 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 23064 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@248e6af2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23064 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@248e6af2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23067 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 23069 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@a0e6746[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23069 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@a0e6746[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23071 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 23083 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 23084 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 23104 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23231 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23232 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23234 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/cores
   [junit4]   2> 23234 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 23257 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 23273 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 23299 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 23305 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 23309 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 23310 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23310 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/cores/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard0/cores/collection1/data/]
   [junit4]   2> 23312 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44923680024500834]
   [junit4]   2> 23355 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 23356 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 23360 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 23360 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 23361 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=27.8359375, floorSegmentMB=0.9189453125, forceMergeDeletesPctAllowed=2.2111407928130444, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.68051544221077
   [junit4]   2> 23363 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 23363 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 23363 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=a_s,minQueryLength=3}
   [junit4]   2> 23364 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 23367 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 23368 INFO  (coreLoadExecutor-94-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692506856951382016
   [junit4]   2> 23371 INFO  (searcherExecutor-96-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 23474 INFO  (searcherExecutor-96-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 23572 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/cores/collection1
   [junit4]   2> 23574 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 23574 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 23574 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 23576 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 23576 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 23576 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 23577 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1561ff0e{/,null,AVAILABLE}
   [junit4]   2> 23578 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@46b2e3bf{SSL, (ssl, http/1.1)}{127.0.0.1:37339}
   [junit4]   2> 23578 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server Started @23623ms
   [junit4]   2> 23578 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema11.xml, solrconfig=solrconfig-collapseqparser.xml, hostContext=/, hostPort=37339, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/cores}
   [junit4]   2> 23579 ERROR (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T17:12:00.027Z
   [junit4]   2> 23579 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/solr.xml
   [junit4]   2> 23582 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 23582 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 23583 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 23909 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 23910 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 23912 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6297fabf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23912 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6297fabf[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23917 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 23918 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@c77bb78[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23918 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@c77bb78[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 23919 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 23931 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 23931 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 23951 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23962 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23962 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 23976 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/cores
   [junit4]   2> 23976 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 23988 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 24015 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 24029 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 24035 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 24040 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 24040 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 24040 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/cores/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard1/cores/collection1/data/]
   [junit4]   2> 24042 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44923680024500834]
   [junit4]   2> 24085 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 24085 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 24087 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 24087 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 24087 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=27.8359375, floorSegmentMB=0.9189453125, forceMergeDeletesPctAllowed=2.2111407928130444, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.68051544221077
   [junit4]   2> 24089 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 24090 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 24090 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=a_s,minQueryLength=3}
   [junit4]   2> 24090 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 24094 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 24094 INFO  (coreLoadExecutor-113-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692506857712648192
   [junit4]   2> 24095 INFO  (searcherExecutor-115-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 24097 INFO  (searcherExecutor-115-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 24206 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/cores/collection1
   [junit4]   2> 24208 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 24208 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 24209 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 24209 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 24209 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 24210 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 24210 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c41caff{/,null,AVAILABLE}
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@22efbe1{SSL, (ssl, http/1.1)}{127.0.0.1:46043}
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.s.Server Started @24257ms
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {schema=schema11.xml, solrconfig=solrconfig-collapseqparser.xml, hostContext=/, hostPort=46043, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/cores}
   [junit4]   2> 24212 ERROR (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 24212 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T17:12:00.660Z
   [junit4]   2> 24213 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/solr.xml
   [junit4]   2> 24215 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 24215 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 24217 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 25241 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 25242 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 25244 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4cd15e81[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 25244 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4cd15e81[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 25247 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.s.i.Http2SolrClient Create Http2SolrClient with HTTP/1.1 transport since Java 8 or lower versions does not support SSL + HTTP/2
   [junit4]   2> 25249 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@32a5013c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 25249 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@32a5013c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 25250 WARN  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 25264 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 25264 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 25282 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 25294 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 25295 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 25296 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/cores
   [junit4]   2> 25297 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 25306 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.c.SolrResourceLoader Added 2 libs to classloader, from paths: [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 25323 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 25337 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Schema name=example
   [junit4]   2> 25343 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.s.IndexSchema Loaded schema example/1.1 with uniqueid field id
   [junit4]   2> 25347 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 25347 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@bc600bc
   [junit4]   2> 25347 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/cores/collection1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001/tempDir-001/shard2/cores/collection1/data/]
   [junit4]   2> 25350 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.44923680024500834]
   [junit4]   2> 25405 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 25405 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 25407 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 25407 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 25408 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=27.8359375, floorSegmentMB=0.9189453125, forceMergeDeletesPctAllowed=2.2111407928130444, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.68051544221077
   [junit4]   2> 25409 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf
   [junit4]   2> 25410 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 25410 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=a_s,minQueryLength=3}
   [junit4]   2> 25410 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.h.c.QueryElevationComponent Loading QueryElevation from: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   2> 25414 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 25414 INFO  (coreLoadExecutor-132-thread-1) [    x:collection1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692506859096768512
   [junit4]   2> 25415 INFO  (searcherExecutor-134-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 25418 INFO  (searcherExecutor-134-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 25917 INFO  (TEST-DistributedExpandComponentTest.test-seed#[B418D26D05E3D811]) [     ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 26089 INFO  (qtp226535946-73) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1692506859779391488)} 0 24
   [junit4]   2> 26140 INFO  (qtp191248686-96) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1692506859856986112)} 0 2
   [junit4]   2> 26212 INFO  (qtp355612406-120) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1692506859930386432)} 0 3
   [junit4]   2> 26273 INFO  (qtp1424054013-139) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1692506859994349568)} 0 3
   [junit4]   2> 26293 INFO  (qtp226535946-74) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1 (1692506860006932480)]} 0 13
   [junit4]   2> 26301 INFO  (qtp191248686-97) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1 (1692506860024758272)]} 0 2
   [junit4]   2> 26304 INFO  (qtp226535946-67) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[2 (1692506860030001152)]} 0 1
   [junit4]   2> 26316 INFO  (qtp191248686-93) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[2 (1692506860041535488)]} 0 1
   [junit4]   2> 26322 INFO  (qtp226535946-69) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[5 (1692506860048875520)]} 0 1
   [junit4]   2> 26327 INFO  (qtp355612406-116) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[5 (1692506860053069824)]} 0 1
   [junit4]   2> 26330 INFO  (qtp226535946-72) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[6 (1692506860056215552)]} 0 0
   [junit4]   2> 26379 INFO  (qtp355612406-117) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[6 (1692506860059361280)]} 0 47
   [junit4]   2> 26385 INFO  (qtp226535946-73) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[7 (1692506860113887232)]} 0 1
   [junit4]   2> 26388 INFO  (qtp191248686-94) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[7 (1692506860118081536)]} 0 1
   [junit4]   2> 26391 INFO  (qtp226535946-74) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[8 (1692506860120178688)]} 0 1
   [junit4]   2> 26396 INFO  (qtp355612406-118) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[8 (1692506860125421568)]} 0 0
   [junit4]   2> 26398 INFO  (qtp226535946-67) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[9 (1692506860128567296)]} 0 0
   [junit4]   2> 26406 INFO  (qtp1424054013-140) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[9 (1692506860135907328)]} 0 1
   [junit4]   2> 26409 INFO  (qtp226535946-69) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[10 (1692506860139053056)]} 0 0
   [junit4]   2> 26411 INFO  (qtp1424054013-141) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[10 (1692506860142198784)]} 0 0
   [junit4]   2> 26413 INFO  (qtp226535946-72) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[88 (1692506860144295936)]} 0 0
   [junit4]   2> 26416 INFO  (qtp1424054013-142) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[88 (1692506860146393088)]} 0 0
   [junit4]   2> 26418 INFO  (qtp226535946-73) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[99 (1692506860148490240)]} 0 0
   [junit4]   2> 26420 INFO  (qtp1424054013-143) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[99 (1692506860151635968)]} 0 1
   [junit4]   2> 26422 INFO  (qtp226535946-74) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[11 (1692506860152684544)]} 0 0
   [junit4]   2> 26424 INFO  (qtp1424054013-139) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[11 (1692506860154781696)]} 0 0
   [junit4]   2> 26428 INFO  (qtp226535946-67) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[12 (1692506860160024576)]} 0 0
   [junit4]   2> 26434 INFO  (qtp355612406-119) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[12 (1692506860165267456)]} 0 0
   [junit4]   2> 26435 INFO  (qtp226535946-69) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[13 (1692506860167364608)]} 0 0
   [junit4]   2> 26437 INFO  (qtp355612406-120) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[13 (1692506860169461760)]} 0 0
   [junit4]   2> 26439 INFO  (qtp226535946-72) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[14 (1692506860171558912)]} 0 0
   [junit4]   2> 26442 INFO  (qtp355612406-116) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[14 (1692506860174704640)]} 0 0
   [junit4]   2> 26612 INFO  (searcherExecutor-77-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 103 ms
   [junit4]   2> 26614 INFO  (qtp226535946-73) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 169
   [junit4]   2> 26628 INFO  (searcherExecutor-96-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 26628 INFO  (qtp191248686-95) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 12
   [junit4]   2> 26640 INFO  (searcherExecutor-115-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 26640 INFO  (qtp355612406-117) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 10
   [junit4]   2> 26656 INFO  (searcherExecutor-134-thread-1-processing-x:collection1) [    x:collection1 ] o.a.s.c.SolrCore [collection1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 26656 INFO  (qtp1424054013-140) [    x:collection1 ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 14
   [junit4]   2> 27060 INFO  (qtp226535946-74) [    x:collection1 ] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&defType=edismax&expand=true&distrib=false&bf=field(test_i)&fl=*,score&fq={!collapse+field%3Dgroup_s}&wt=javabin&version=2} hits=4 status=0 QTime=402
   [junit4]   2> 27138 ERROR (qtp1424054013-141) [    x:collection1 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero
   [junit4]   2> 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:477)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:766)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:409)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandlerFactory.makeLoadBalancedRequest(HttpShardHandlerFactory.java:371)
   [junit4]   2> 	at org.apache.solr.handler.component.ShardRequestor.call(ShardRequestor.java:132)
   [junit4]   2> 	at org.apache.solr.handler.component.ShardRequestor.call(ShardRequestor.java:41)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:180)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:218)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	... 1 more
   [junit4]   2> Caused by: java.lang.ArithmeticException: / by zero
   [junit4]   2> 	at org.eclipse.jetty.util.Pool.acquire(Pool.java:278)
   [junit4]   2> 	at org.eclipse.jetty.client.AbstractConnectionPool.activate(AbstractConnectionPool.java:284)
   [junit4]   2> 	at org.eclipse.jetty.client.AbstractConnectionPool.acquire(AbstractConnectionPool.java:209)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpDestination.process(HttpDestination.java:331)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpDestination.send(HttpDestination.java:318)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpDestination.send(HttpDestination.java:311)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpDestination.send(HttpDestination.java:288)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpDestination.send(HttpDestination.java:265)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpClient.send(HttpClient.java:594)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpRequest.send(HttpRequest.java:772)
   [junit4]   2> 	at org.eclipse.jetty.client.HttpRequest.send(HttpRequest.java:764)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:400)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:761)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
   [junit4]   2> 	... 12 more
   [junit4]   2> 
   [junit4]   2> 27139 INFO  (qtp1424054013-141) [    x:collection1 ] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[::1]:6/|[::1]:8/|https://127.0.0.1:37969/collection1|[::1]:4/,[::1]:6/|https://127.0.0.1:37339/collection1,[::1]:8/|https://127.0.0.1:46043/collection1&defType=edismax&expand=true&bf=field(test_i)&fl=*,score&fq={!collapse+field%3Dgroup_s}&wt=javabin&version=2} rid=127.0.0.1-28 status=500 QTime=70
   [junit4]   2> 27140 ERROR (qtp1424054013-141) [    x:collection1 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero
   [junit4]   2> 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:477)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.han

[...truncated too long message...]

ters for registry=solr.jvm tag=null
   [junit4]   2> 27279 INFO  (closeThreadPool-139-thread-7) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@40754ec4: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@9713031
   [junit4]   2> 27281 INFO  (closeThreadPool-139-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@33878858{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 27284 INFO  (closeThreadPool-139-thread-7) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 27285 INFO  (closeThreadPool-139-thread-6) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@46b2e3bf{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 27284 INFO  (closeThreadPool-139-thread-7) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26ce245c: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@3e33b7e2
   [junit4]   2> 27285 INFO  (closeThreadPool-139-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6d79f5a6{/,null,STOPPED}
   [junit4]   2> 27285 INFO  (closeThreadPool-139-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 27302 INFO  (closeThreadPool-139-thread-6) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1561ff0e{/,null,STOPPED}
   [junit4]   2> 27303 INFO  (closeThreadPool-139-thread-6) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 27307 INFO  (closeThreadPool-139-thread-7) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@22efbe1{SSL, (ssl, http/1.1)}{127.0.0.1:0}
   [junit4]   2> 27308 INFO  (closeThreadPool-139-thread-7) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c41caff{/,null,STOPPED}
   [junit4]   2> 27308 INFO  (closeThreadPool-139-thread-7) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistributedExpandComponentTest -Dtests.method=test -Dtests.seed=B418D26D05E3D811 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=Pacific/Saipan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   7.67s J0 | DistributedExpandComponentTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46043/collection1: org.apache.solr.client.solrj.SolrServerException: java.lang.ArithmeticException: / by zero
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B418D26D05E3D811:3C4CEDB7AB1FB5E9]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1003)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:1018)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:625)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:677)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:655)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:634)
   [junit4]    > 	at org.apache.solr.handler.component.DistributedExpandComponentTest._test(DistributedExpandComponentTest.java:94)
   [junit4]    > 	at org.apache.solr.handler.component.DistributedExpandComponentTest.test(DistributedExpandComponentTest.java:49)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 27316 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 27316 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1763136091
   [junit4]   2> 27328 INFO  (coreCloseExecutor-157-thread-1) [     ] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@31d13af4
   [junit4]   2> 27328 INFO  (coreCloseExecutor-157-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1 tag=SolrCore@31d13af4
   [junit4]   2> 27328 INFO  (coreCloseExecutor-157-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@62096dba: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1/com.codahale.metrics.MetricRegistry@18f31314
   [junit4]   2> 27332 INFO  (coreCloseExecutor-157-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 27340 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 27340 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4f57f39f: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@69970239
   [junit4]   2> 27341 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 27341 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2a7f89e5: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@9713031
   [junit4]   2> 27341 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 27341 INFO  (SUITE-DistributedExpandComponentTest-seed#[B418D26D05E3D811]-worker) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a7b98d6: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@3e33b7e2
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J0/temp/solr.handler.component.DistributedExpandComponentTest_B418D26D05E3D811-001
   [junit4]   2> NOTE: test params are: codec=Lucene87, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=mk, timezone=Pacific/Saipan
   [junit4]   2> NOTE: Linux 4.15.0-112-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=155147040,total=306184192
   [junit4]   2> NOTE: All tests run in this JVM: [TestBinaryField, TolerantUpdateProcessorTest, DistributedExpandComponentTest]
   [junit4] Completed [9/934 (1!)] on J0 in 10.18s, 1 test, 1 error <<< FAILURES!

[...truncated 53899 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1631 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1631/

All tests passed

Build Log:
[...truncated 67151 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 69 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1630 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1630/

1 tests failed.
FAILED:  org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver

Error Message:
Error from server at http://127.0.0.1:35289/solr: Underlying core creation failed while creating collection: testLeaderFailsOver

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35289/solr: Underlying core creation failed while creating collection: testLeaderFailsOver
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:369)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:297)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1171)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:934)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:866)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.LeaderTragicEventTest.testLeaderFailsOver(LeaderTragicEventTest.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15015 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderTragicEventTest
   [junit4]   2> 1408264 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1408264 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1408264 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/data-dir-107-001
   [junit4]   2> 1408265 WARN  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1408265 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1408266 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1408267 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001
   [junit4]   2> 1408267 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1408267 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1408267 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1408268 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 1408367 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 46765
   [junit4]   2> 1408368 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:46765
   [junit4]   2> 1408368 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:46765
   [junit4]   2> 1408368 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 46765
   [junit4]   2> 1408369 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1408372 INFO  (zkConnectionManagerCallback-17673-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1408372 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1408374 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1408375 INFO  (zkConnectionManagerCallback-17675-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1408375 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1408376 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1408377 INFO  (zkConnectionManagerCallback-17677-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1408377 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1408479 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1408486 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1408486 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1408486 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3143a05a{/solr,null,AVAILABLE}
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@13aead78{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:35289}
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.e.j.s.Server Started @1408515ms
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46765/solr, hostPort=35289}
   [junit4]   2> 1408487 ERROR (jetty-launcher-17678-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41355125{/solr,null,AVAILABLE}
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1408487 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T09:53:16.703Z
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@56b0fe99{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44107}
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.e.j.s.Server Started @1408516ms
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46765/solr, hostPort=44107}
   [junit4]   2> 1408488 ERROR (jetty-launcher-17678-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T09:53:16.704Z
   [junit4]   2> 1408488 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1408489 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1408490 INFO  (zkConnectionManagerCallback-17680-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1408490 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1408490 INFO  (zkConnectionManagerCallback-17682-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1408490 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1408491 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1408491 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1408494 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1408494 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1408494 WARN  (jetty-launcher-17678-thread-1-SendThread(127.0.0.1:46765)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103853bc9fc0003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1408495 WARN  (jetty-launcher-17678-thread-2-SendThread(127.0.0.1:46765)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103853bc9fc0004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1409002 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1409003 WARN  (jetty-launcher-17678-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2d5d97e5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409003 WARN  (jetty-launcher-17678-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2d5d97e5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409040 WARN  (jetty-launcher-17678-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@98443ed[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409040 WARN  (jetty-launcher-17678-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@98443ed[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409042 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46765/solr
   [junit4]   2> 1409058 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1409058 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1409059 WARN  (jetty-launcher-17678-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7c9a553c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409059 WARN  (jetty-launcher-17678-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7c9a553c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409061 WARN  (jetty-launcher-17678-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@46274bba[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409061 WARN  (jetty-launcher-17678-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@46274bba[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1409062 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46765/solr
   [junit4]   2> 1409063 INFO  (zkConnectionManagerCallback-17696-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1409063 INFO  (jetty-launcher-17678-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1409066 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1409066 INFO  (zkConnectionManagerCallback-17704-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1409066 INFO  (jetty-launcher-17678-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1409066 WARN  (jetty-launcher-17678-thread-1-SendThread(127.0.0.1:46765)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103853bc9fc0005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1409182 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1409194 INFO  (zkConnectionManagerCallback-17706-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1409194 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1409253 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35289_solr
   [junit4]   2> 1409253 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.Overseer Overseer (id=73048510806360071-127.0.0.1:35289_solr-n_0000000000) starting
   [junit4]   2> 1409266 INFO  (OverseerStateUpdate-73048510806360071-127.0.0.1:35289_solr-n_0000000000) [n:127.0.0.1:35289_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:35289_solr
   [junit4]   2> 1409291 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35289_solr
   [junit4]   2> 1409314 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1409316 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1409316 WARN  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1409347 INFO  (jetty-launcher-17678-thread-1) [n:127.0.0.1:35289_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node1
   [junit4]   2> 1409350 INFO  (zkConnectionManagerCallback-17714-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1409350 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1409351 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1409353 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1409356 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:44107_solr as DOWN
   [junit4]   2> 1409356 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1409356 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44107_solr
   [junit4]   2> 1409396 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1409396 WARN  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1409410 INFO  (zkCallback-17713-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1409424 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1409427 INFO  (jetty-launcher-17678-thread-2) [n:127.0.0.1:44107_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2
   [junit4]   2> 1409462 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 1409486 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1409495 INFO  (zkConnectionManagerCallback-17729-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1409495 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1409498 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1409498 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46765/solr ready
   [junit4]   2> 1409522 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOtherReplicasAreNotActive
   [junit4]   2> 1409542 INFO  (OverseerThreadFactory-17715-thread-1-processing-n:127.0.0.1:35289_solr) [n:127.0.0.1:35289_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testOtherReplicasAreNotActive
   [junit4]   2> 1409655 INFO  (OverseerStateUpdate-73048510806360071-127.0.0.1:35289_solr-n_0000000000) [n:127.0.0.1:35289_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:35289_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:35289/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1409657 INFO  (OverseerStateUpdate-73048510806360071-127.0.0.1:35289_solr-n_0000000000) [n:127.0.0.1:35289_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>   "node_name":"127.0.0.1:44107_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:44107/solr",
   [junit4]   2>   "collection":"testOtherReplicasAreNotActive",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1409879 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1409880 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr    x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1409907 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr    x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1409920 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1409954 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1409955 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1409955 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1409955 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n1' using configuration from configset config, trusted=true
   [junit4]   2> 1409955 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node1/testOtherReplicasAreNotActive_shard1_replica_n1/data/]
   [junit4]   2> 1409961 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1409962 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1409962 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1409962 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 1410005 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1410005 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1410005 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1410005 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1410007 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1410008 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1410008 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1410008 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692479256761729024
   [junit4]   2> 1410010 INFO  (searcherExecutor-17731-thread-1-processing-n:127.0.0.1:35289_solr x:testOtherReplicasAreNotActive_shard1_replica_n1 c:testOtherReplicasAreNotActive s:shard1 r:core_node3) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1410014 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1410014 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1410015 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1410015 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1410016 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1410016 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1410016 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1410016 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692479256770117632
   [junit4]   2> 1410018 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1410018 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1410023 INFO  (searcherExecutor-17733-thread-1-processing-n:127.0.0.1:44107_solr x:testOtherReplicasAreNotActive_shard1_replica_n2 c:testOtherReplicasAreNotActive s:shard1 r:core_node4) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1410027 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testOtherReplicasAreNotActive/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1410027 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testOtherReplicasAreNotActive/leaders/shard1
   [junit4]   2> 1410028 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1410028 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1410028 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35289/solr/testOtherReplicasAreNotActive_shard1_replica_n1/
   [junit4]   2> 1410029 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n1 url=http://127.0.0.1:35289/solr  START replicas=[http://127.0.0.1:44107/solr/testOtherReplicasAreNotActive_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1410029 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=testOtherReplicasAreNotActive_shard1_replica_n1 url=http://127.0.0.1:35289/solr  DONE. We have no versions. sync failed.
   [junit4]   2> 1410030 INFO  (qtp1484200935-31858) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1410031 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1410031 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1410031 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testOtherReplicasAreNotActive/leaders/shard1/leader after winning as /collections/testOtherReplicasAreNotActive/leader_elect/shard1/election/73048510806360071-core_node3-n_0000000000
   [junit4]   2> 1410033 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35289/solr/testOtherReplicasAreNotActive_shard1_replica_n1/ shard1
   [junit4]   2> 1410135 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410135 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410136 INFO  (zkCallback-17705-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410136 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1410140 INFO  (qtp493441189-31851) [n:127.0.0.1:35289_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n1&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=260
   [junit4]   2> 1410239 INFO  (zkCallback-17705-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410239 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410239 INFO  (zkCallback-17705-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1410239 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411035 INFO  (qtp1484200935-31856) [n:127.0.0.1:44107_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testOtherReplicasAreNotActive_shard1_replica_n2&action=CREATE&numShards=1&collection=testOtherReplicasAreNotActive&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1129
   [junit4]   2> 1411038 INFO  (qtp493441189-31848) [n:127.0.0.1:35289_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1411137 INFO  (zkCallback-17705-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411137 INFO  (zkCallback-17705-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411137 INFO  (zkCallback-17713-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411137 INFO  (zkCallback-17713-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411137 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411137 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1411138 INFO  (qtp493441189-31848) [n:127.0.0.1:35289_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=config&name=testOtherReplicasAreNotActive&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1605
   [junit4]   2> 1411138 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testOtherReplicasAreNotActive
   [junit4]   2> 1411145 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.LeaderTragicEventTest Stop jetty node : http://127.0.0.1:44107/solr state:DocCollection(testOtherReplicasAreNotActive//collections/testOtherReplicasAreNotActive/state.json/4 )={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>           "node_name":"127.0.0.1:35289_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:35289/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testOtherReplicasAreNotActive_shard1_replica_n2",
   [junit4]   2>           "node_name":"127.0.0.1:44107_solr",
   [junit4]   2>           "base_url":"http://127.0.0.1:44107/solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 1411146 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1904230975
   [junit4]   2> 1411146 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44107_solr
   [junit4]   2> 1411146 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1411146 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:44107_solr as DOWN
   [junit4]   2> 1411148 INFO  (coreCloseExecutor-17745-thread-1) [n:127.0.0.1:44107_solr     ] o.a.s.c.SolrCore [testOtherReplicasAreNotActive_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@7d154b55
   [junit4]   2> 1411148 INFO  (coreCloseExecutor-17745-thread-1) [n:127.0.0.1:44107_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testOtherReplicasAreNotActive.shard1.replica_n2 tag=SolrCore@7d154b55
   [junit4]   2> 1411148 INFO  (coreCloseExecutor-17745-thread-1) [n:127.0.0.1:44107_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testOtherReplicasAreNotActive.shard1.leader tag=SolrCore@7d154b55
   [junit4]   2> 1411149 INFO  (coreCloseExecutor-17745-thread-1) [n:127.0.0.1:44107_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1411151 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1411151 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1411151 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1411152 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1411153 WARN  (jetty-launcher-17678-thread-2-SendThread(127.0.0.1:46765)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103853bc9fc0008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc0008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1411154 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1411154 INFO  (zkCallback-17728-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1411250 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1411250 INFO  (zkCallback-17705-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1411250 INFO  (zkCallback-17705-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1411250 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1411255 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@56b0fe99{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1411256 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@41355125{/solr,null,STOPPED}
   [junit4]   2> 1411256 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1411256 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 44107
   [junit4]   2> 1411257 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testOtherReplicasAreNotActive): Timeout waiting for replica get down
   [junit4]   2> 1411261 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node3:{
   [junit4]   2>   "core":"testOtherReplicasAreNotActive_shard1_replica_n1",
   [junit4]   2>   "node_name":"127.0.0.1:35289_solr",
   [junit4]   2>   "base_url":"http://127.0.0.1:35289/solr",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "leader":"true"}
   [junit4]   2> 1411265 ERROR (qtp493441189-31847) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Error closing IndexWriter
   [junit4]   2>           => java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894)
   [junit4]   2> java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3894) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3886) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1235) ~[java/:?]
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1278) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:298) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:209) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.update.DefaultSolrCoreState.newIndexWriter(DefaultSolrCoreState.java:233) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.checkTragicException(CoreContainer.java:2208) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:229) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) ~[jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) [jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_281]
   [junit4]   2> Caused by: java.lang.Exception: injected tragedy
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:364) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210) ~[java/:?]
   [junit4]   2> 	... 36 more
   [junit4]   2> 1411268 INFO  (qtp493441189-31847) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1411268 ERROR (qtp493441189-31847) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1411268 INFO  (qtp493441189-31847) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.c.S.Request [testOtherReplicasAreNotActive_shard1_replica_n1]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2} status=500 QTime=5
   [junit4]   2> 1411268 ERROR (qtp493441189-31847) [n:127.0.0.1:35289_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node3 x:testOtherReplicasAreNotActive_shard1_replica_n1 ] o.a.s.s.HttpSolrCall org.apache.solr.common.SolrException: Random tragedy fail
   [junit4]   2> 	at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:374)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:210)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2638)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:516)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1411271 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=44107)
   [junit4]   2> 1411272 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 44107 try number 2 ...
   [junit4]   2> 1411272 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 1.8.0_281-b09
   [junit4]   2> 1411272 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1411272 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1411272 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@756b2e6d{/solr,null,AVAILABLE}
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@1405a53e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44107}
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.s.Server Started @1411301ms
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, zkHost=127.0.0.1:46765/solr, hostPort=44107}
   [junit4]   2> 1411273 ERROR (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.9.0
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr
   [junit4]   2> 1411273 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2021-02-23T09:53:19.489Z
   [junit4]   2> 1411274 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1411278 INFO  (zkConnectionManagerCallback-17749-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1411278 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1411278 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1411282 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
   [junit4]   2> 1411542 INFO  (OverseerCollectionConfigSetProcessor-73048510806360071-127.0.0.1:35289_solr-n_0000000000) [n:127.0.0.1:35289_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1411838 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1411839 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3a26037d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1411839 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3a26037d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1411842 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@adcd770[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1411842 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@adcd770[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1411843 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46765/solr
   [junit4]   2> 1411843 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1411844 INFO  (zkConnectionManagerCallback-17760-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1411845 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1411947 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1411948 INFO  (zkConnectionManagerCallback-17762-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1411948 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1411954 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1411959 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:44107_solr as DOWN
   [junit4]   2> 1411960 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1411960 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44107_solr
   [junit4]   2> 1411962 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1411962 INFO  (zkCallback-17761-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1411962 INFO  (zkCallback-17728-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1411964 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1411964 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1411981 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2
   [junit4]   2> 1411981 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [n:127.0.0.1:44107_solr     ] o.a.s.c.CorePropertiesLocator Cores are: [testOtherReplicasAreNotActive_shard1_replica_n2]
   [junit4]   2> 1411993 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1412002 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr     ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1412002 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr     ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1412012 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.9.0
   [junit4]   2> 1412032 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1412033 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1412033 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testOtherReplicasAreNotActive_shard1_replica_n2' using configuration from configset config, trusted=true
   [junit4]   2> 1412033 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.c.SolrCore [[testOtherReplicasAreNotActive_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001/tempDir-001/node2/testOtherReplicasAreNotActive_shard1_replica_n2/data/]
   [junit4]   2> 1412061 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1412061 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1412062 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1412062 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1412062 INFO  (zkCallback-17705-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1412062 INFO  (zkCallback-17705-thread-4) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1412062 INFO  (zkCallback-17705-thread-5) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1412062 INFO  (zkCallback-17705-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testOtherReplicasAreNotActive/state.json] for collection [testOtherReplicasAreNotActive] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1412063 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1412064 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1412064 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1412064 INFO  (coreLoadExecutor-17768-thread-1-processing-n:127.0.0.1:44107_solr) [n:127.0.0.1:44107_solr c:testOtherReplicasAreNotActive s:shard1 r:core_node4 x:testOtherReplicasAreNotActive_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1692479258917601280
   [junit4]   2> 1412066 INFO  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]) [     ] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:44107_solr
   [junit4]   2> 1412067 INFO  (searcherExecutor-17770-thread-1-processing-n:127.0.0.1:44107_solr x:testOtherReplicasAr

[...truncated too long message...]

stry=solr.cluster tag=null
   [junit4]   2> 1423072 WARN  (TEST-LeaderTragicEventTest.testOtherReplicasAreNotActive-seed#[2017F788B1DB410]-SendThread(127.0.0.1:46765)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x103853bc9fc000c.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc000c, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x103853bc9fc000c, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1275) [zookeeper-3.6.2.jar:3.6.2]
   [junit4]   2> 1423159 INFO  (jetty-closer-17781-thread-1) [     ] o.a.s.c.Overseer Overseer (id=73048510806360071-127.0.0.1:35289_solr-n_0000000000) closing
   [junit4]   2> 1423160 INFO  (jetty-closer-17781-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@13aead78{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1423160 INFO  (jetty-closer-17781-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3143a05a{/solr,null,STOPPED}
   [junit4]   2> 1423160 INFO  (jetty-closer-17781-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1423595 INFO  (jetty-closer-17781-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@1405a53e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:44107}
   [junit4]   2> 1423595 INFO  (jetty-closer-17781-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@756b2e6d{/solr,null,STOPPED}
   [junit4]   2> 1423595 INFO  (jetty-closer-17781-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1423596 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1423799 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections/testOtherReplicasAreNotActive/terms/shard1
   [junit4]   2> 	4	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/configs/config
   [junit4]   2> 	3	/solr/collections/testLeaderFailsOver/terms/shard1
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	33	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/73048510806360071-127.0.0.1:35289_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	40	/solr/overseer/queue
   [junit4]   2> 	16	/solr/collections
   [junit4]   2> 	15	/solr/overseer/collection-queue-work
   [junit4]   2> 	13	/solr/live_nodes
   [junit4]   2> 	12	/solr/collections/testOtherReplicasAreNotActive/state.json
   [junit4]   2> 	4	/solr/collections/testLeaderFailsOver/state.json
   [junit4]   2> 
   [junit4]   2> 1423803 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:46765
   [junit4]   2> 1423803 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:46765
   [junit4]   2> 1423803 INFO  (SUITE-LeaderTragicEventTest-seed#[2017F788B1DB410]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 46765
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderTragicEventTest_2017F788B1DB410-001
   [junit4]   2> Feb 23, 2021 9:53:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene87): {}, docValues:{}, maxPointsInLeafNode=1099, maxMBSortInHeap=6.870061810938738, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ms, timezone=Asia/Dili
   [junit4]   2> NOTE: Linux 5.4.0-45-generic amd64/Oracle Corporation 1.8.0_281 (64-bit)/cpus=4,threads=1,free=142475312,total=525336576
   [junit4]   2> NOTE: All tests run in this JVM: [ReplicationFactorTest, TestMinHashQParser, DeleteReplicaTest, TestCloudNestedDocsSort, TestBulkSchemaConcurrent, HttpTriggerListenerTest, TestAddFieldRealTimeGet, TestDistribPackageStore, TestMultiValuedNumericRangeQuery, TestTestInjection, TestZkChroot, VersionInfoTest, BlockJoinFacetRandomTest, HdfsRecoverLeaseTest, SolrGraphiteReporterTest, TestInfoStreamLogging, TestExactSharedStatsCache, DistributedFacetExistsSmallTest, PeerSyncWithLeaderTest, TestSolr4Spatial2, NumberUtilsTest, TestSortByMinMaxFunction, MetricsHistoryHandlerTest, DirectSolrConnectionTest, DistributedTermsComponentTest, SignificantTermsQParserPluginTest, SearchRateTriggerTest, TestPivotHelperCode, TestBackupRepositoryFactory, ByteBuffersDirectoryFactoryTest, JavaBinAtomicUpdateMultivalueTest, DistributedIntervalFacetingTest, AssignBackwardCompatibilityTest, TestCollationFieldDocValues, TestConfigReload, AutoScalingHandlerTest, TestSimNodeLostTrigger, TestSafeXMLParsing, DistributedQueryComponentOptimizationTest, ScheduledMaintenanceTriggerTest, RegexBoostProcessorTest, TestSolrConfigHandler, ZkNodePropsTest, TestStreamBody, TestReversedWildcardFilterFactory, HttpPartitionOnCommitTest, ManagedSchemaRoundRobinCloudTest, CategoryRoutedAliasUpdateProcessorTest, TestStressLiveNodes, TestUninvertingReader, DateRangeFieldTest, TestExternalRoleRuleBasedAuthorizationPlugin, ConnectionReuseTest, TestSubQueryTransformerDistrib, TestBM25SimilarityFactory, TermsComponentTest, TestFastOutputStream, LeaderElectionIntegrationTest, TestSimExtremeIndexing, HdfsThreadLeakTest, FileBasedSpellCheckerTest, DirectoryFactoriesTest, SuggestComponentContextFilterQueryTest, TestConfigOverlay, EmbeddedSolrNoSerializeTest, TestDistributedMap, TestUnifiedSolrHighlighter, LargeFieldTest, TestSolrJ, TestSweetSpotSimilarityFactory, PolyFieldTest, TestStressVersions, TestSolrXml, TestCoreAdminApis, TestEmbeddedSolrServerAdminHandler, TestRebalanceLeaders, CdcrBootstrapTest, TestDFRSimilarityFactory, ShowFileRequestHandlerTest, TestClusterProperties, TestInPlaceUpdatesRequiredField, TestLegacyField, TestExceedMaxTermLength, SolrCloudReportersTest, LoggingHandlerTest, TestRawTransformer, TestFieldCacheWithThreads, CustomTermsComponentTest, TestUseDocValuesAsStored, NodeLostTriggerIntegrationTest, AnalyticsQueryTest, SolrIndexConfigTest, TestSchemaManager, TestOverriddenPrefixQueryForCustomFieldType, TestCollectionAPI, PackageManagerCLITest, TestRecoveryHdfs, TestMiniSolrCloudClusterSSL, CollectionsAPIAsyncDistributedZkTest, PurgeGraphTest, TestChildDocTransformerHierarchy, DistribDocExpirationUpdateProcessorTest, TestSimUtils, ExplicitHLLTest, TriggerEventQueueTest, TestUpdate, TestFieldCacheReopen, ZkDynamicConfigTest, CollectionsAPISolrJTest, PeerSyncTest, TestFreeTextSuggestions, LeaderTragicEventTest]
   [junit4] Completed [550/934 (1!)] on J1 in 16.27s, 2 tests, 1 error <<< FAILURES!

[...truncated 52170 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 73 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1629 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1629/

All tests passed

Build Log:
[...truncated 67156 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1628 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1628/

All tests passed

Build Log:
[...truncated 67145 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 72 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1627 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1627/

All tests passed

Build Log:
[...truncated 67166 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1626 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1626/

All tests passed

Build Log:
[...truncated 67144 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 68 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1625 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1625/

All tests passed

Build Log:
[...truncated 67161 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 67 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1624 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1624/

All tests passed

Build Log:
[...truncated 67144 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 70 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene » Lucene-Solr-Tests-8.x - Build # 1623 - Still Failing!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Solr-Tests-8.x/1623/

All tests passed

Build Log:
[...truncated 67182 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:634: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:507: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene/Lucene-Solr-Tests-8.x/build.xml:494: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* solr/contrib/analytics/src/test-files/solr/filestore
* solr/contrib/analytics/src/test-files/solr/userfiles
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/collection1/conf/dataimport.properties
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/filestore
* solr/contrib/dataimporthandler-extras/src/test-files/dihextras/solr/userfiles
* solr/contrib/dataimporthandler/src/test-files/dih/solr/filestore
* solr/contrib/dataimporthandler/src/test-files/dih/solr/userfiles
* solr/contrib/extraction/src/test-files/extraction/solr/filestore
* solr/contrib/extraction/src/test-files/extraction/solr/userfiles
* solr/contrib/langid/src/test-files/langid/solr/filestore
* solr/contrib/langid/src/test-files/langid/solr/userfiles
* solr/contrib/ltr/src/test-files/solr/filestore
* solr/contrib/ltr/src/test-files/solr/userfiles
* solr/contrib/prometheus-exporter/src/test-files/solr/filestore
* solr/contrib/prometheus-exporter/src/test-files/solr/userfiles
* solr/contrib/velocity/src/test-files/velocity/solr/filestore
* solr/contrib/velocity/src/test-files/velocity/solr/userfiles
* solr/core/src/test-files/solr/filestore
* solr/core/src/test-files/solr/userfiles
* solr/solrj/src/test-files/solrj/solr/multicore/filestore
* solr/solrj/src/test-files/solrj/solr/multicore/userfiles

Total time: 71 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any