You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@solr.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2026/09/03 10:52:13 UTC
[JENKINS] Solr » Solr-Test-10.0 - Build # 2373 - Unstable!
Build: https://ci-builds.apache.org/job/Solr/job/Solr-Test-10.0/2373/
1 tests failed.
FAILED: org.apache.solr.cloud.LeaderTragicEventTest.classMethod
Error Message:
java.lang.Exception: Error shutting down MiniSolrCloudCluster
Stack Trace:
java.lang.Exception: Error shutting down MiniSolrCloudCluster
at __randomizedtesting.SeedInfo.seed([6316115B34DB0BF8]:0)
at org.apache.solr.cloud.MiniSolrCloudCluster.checkForExceptions(MiniSolrCloudCluster.java:767)
at org.apache.solr.cloud.MiniSolrCloudCluster.shutdown(MiniSolrCloudCluster.java:677)
at org.apache.solr.cloud.SolrCloudTestCase.shutdownCluster(SolrCloudTestCase.java:144)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:909)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
at java.base/java.lang.Thread.run(Thread.java:1583)
Suppressed: java.util.concurrent.TimeoutException
at java.base/java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1960)
at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2095)
at org.eclipse.jetty.server.Server.doStop(Server.java:663)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:132)
at org.apache.solr.embedded.JettySolrRunner.stop(JettySolrRunner.java:630)
at org.apache.solr.cloud.MiniSolrCloudCluster.stopJettySolrRunner(MiniSolrCloudCluster.java:562)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$shutdown$5(MiniSolrCloudCluster.java:669)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:381)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
... 1 more
Build Log:
[...truncated 11 lines...]
ERROR: Workspace has a .git repository, but it appears to be corrupt.
hudson.plugins.git.GitException: Command "git rev-parse --resolve-git-dir /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/.git" returned status code 128:
stdout:
stderr: fatal: not a gitdir '/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/.git'
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2848)
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2768)
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2763)
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:2052)
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:2064)
at PluginClassLoader for git-client//org.jenkinsci.plugins.gitclient.CliGitAPIImpl.hasGitRepo(CliGitAPIImpl.java:404)
at PluginClassLoader for git-client//hudson.plugins.git.GitAPI.hasGitRepo(GitAPI.java:281)
at jdk.internal.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:986)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:961)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:907)
at hudson.remoting.UserRequest.perform(UserRequest.java:225)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:391)
at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:81)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
Cloning the remote Git repository
Cloning repository https://gitbox.apache.org/repos/asf/solr.git
> git init /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0 # timeout=10
Fetching upstream changes from https://gitbox.apache.org/repos/asf/solr.git
> git --version # timeout=10
> git --version # 'git version 2.43.0'
> git fetch --tags --force --progress -- https://gitbox.apache.org/repos/asf/solr.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://gitbox.apache.org/repos/asf/solr.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
> git rev-parse refs/remotes/origin/branch_10_0^{commit} # timeout=10
Checking out Revision 93068d1dfbc48816caac29c5b3aba3bf884aea85 (refs/remotes/origin/branch_10_0)
> git config core.sparsecheckout # timeout=10
> git checkout -f 93068d1dfbc48816caac29c5b3aba3bf884aea85 # timeout=10
> git branch -a -v --no-abbrev # timeout=10
> git checkout -b branch_10_0 93068d1dfbc48816caac29c5b3aba3bf884aea85 # timeout=10
Commit message: "Ref Guide - Change component name to Apache Solr (#4521)"
> git rev-list --no-walk 93068d1dfbc48816caac29c5b3aba3bf884aea85 # timeout=10
No emails were triggered.
provisioning config files...
copy managed file [gradle.properties] to file:/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/gradle.properties
[Gradle] - Launching build.
[Solr-Test-10.0] $ /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/gradlew -Dtests.haltonfailure=false -Dtests.badapples=false --continue test
Downloading gradle-wrapper.jar from https://raw.githubusercontent.com/gradle/gradle/v8.10.2/gradle/wrapper/gradle-wrapper.jar
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.10/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
> Task :build-infra:compileJava
Note: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build-tools/build-infra/src/main/java/org/apache/lucene/gradle/Checksum.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :build-infra:pluginDescriptors
> Task :build-infra:processResources
> Task :build-infra:classes
> Task :build-infra:jar
> Task :gitStatus
> Task :checkJdkInternalsExportedToGradle
> Task :solr:api:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:api:processResources NO-SOURCE
> Task :solr:api:classes
> Task :solr:api:jar
> Task :randomizationInfo
Running tests with randomization seed: tests.seed=6316115B34DB0BF8
> Task :solr:api:resolve
SLF4J(W): No SLF4J providers were found.
SLF4J(W): Defaulting to no-operation (NOP) logger implementation
SLF4J(W): See https://www.slf4j.org/codes.html#noProviders for further details.
> Task :solr:solrj:openApiGenerate
Cleaned up output directory /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/solrj/build/generated/ before code generation (cleanupOutput set to true).
No application/json content media type found in response. Response examples can currently only be generated for application/json media type.
############################################################################################
# Thanks for using OpenAPI Generator. #
# We appreciate your support! Please consider donation to help us maintain this project. #
# https://opencollective.com/openapi_generator/donate #
############################################################################################
Successfully generated code to /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/solrj/build/generated/
> Task :spotlessInternalRegisterDependencies
> Task :solr:solrj:generatedSpotlessHelper
> Task :solr:solrj:generatedSpotless
> Task :solr:solrj:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:solrj-jetty:compileJava
Note: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/solrj-jetty/src/java/org/apache/solr/client/solrj/jetty/HttpJettySolrClient.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:solrj-streaming:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:solrj-zookeeper:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:core:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:test-framework:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:api:compileTestJava
> Task :solr:api:processTestResources
> Task :solr:api:testClasses
> Task :solr:core:processResources
> Task :solr:core:classes
> Task :solr:core:jar
> Task :solr:solrj:processResources
> Task :solr:solrj:classes
> Task :solr:solrj:jar
> Task :solr:solrj-jetty:processResources NO-SOURCE
> Task :solr:solrj-jetty:classes
> Task :solr:solrj-jetty:jar
> Task :solr:solrj-streaming:processResources
> Task :solr:solrj-streaming:classes
> Task :solr:solrj-streaming:jar
> Task :solr:solrj-zookeeper:processResources NO-SOURCE
> Task :solr:solrj-zookeeper:classes
> Task :solr:solrj-zookeeper:jar
> Task :solr:test-framework:processResources
> Task :solr:test-framework:classes
> Task :solr:test-framework:jar
> Task :solr:api:test
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
:solr:api:test (SUCCESS): 19 test(s)
> Task :solr:api:wipeTaskTemp
> Task :solr:benchmark:compileJava
> Task :solr:benchmark:processResources
> Task :solr:benchmark:classes
> Task :solr:benchmark:compileTestJava
> Task :solr:benchmark:processTestResources
> Task :solr:benchmark:testClasses
> Task :solr:benchmark:test
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
:solr:benchmark:test (SUCCESS): 10 test(s)
> Task :solr:benchmark:wipeTaskTemp
> Task :solr:core:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:core:processTestResources
> Task :solr:core:testClasses
> Task :solr:modules:analysis-extras:compileJava
Note: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/modules/analysis-extras/src/java/org/apache/solr/schema/ICUCollationField.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:modules:analysis-extras:processResources NO-SOURCE
> Task :solr:modules:analysis-extras:classes
> Task :solr:modules:analysis-extras:jar
> Task :solr:core:test
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
WARNING: Test org.apache.solr.TestRandomDVFaceting wrote 14,108,267 bytes of output.
WARNING: Test org.apache.solr.TestRandomFaceting wrote 34,798,314 bytes of output.
LeaderTragicEventTest > classMethod FAILED
java.lang.Exception: Error shutting down MiniSolrCloudCluster
at __randomizedtesting.SeedInfo.seed([6316115B34DB0BF8]:0)
at org.apache.solr.cloud.MiniSolrCloudCluster.checkForExceptions(MiniSolrCloudCluster.java:767)
at org.apache.solr.cloud.MiniSolrCloudCluster.shutdown(MiniSolrCloudCluster.java:677)
at org.apache.solr.cloud.SolrCloudTestCase.shutdownCluster(SolrCloudTestCase.java:144)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1763)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:909)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
at java.base/java.lang.Thread.run(Thread.java:1583)
org.apache.solr.cloud.LeaderTragicEventTest > test suite's output saved to /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.LeaderTragicEventTest.txt, copied below:
2> 222558 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCase Setting 'solr.configset.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/server/solr/configsets/_default/conf'
2> 222559 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-64 after mutting 0 log messages
2> 222559 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-65 for ERROR logs matching regex: ignore_exception
2> 222560 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/data-dir-28-001
2> 222560 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
2> 222560 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
2> 222561 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
2> 222561 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
2> 222561 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.OpenTelemetryConfigurator OpenTelemetry tracer enabled with simple propagation only.
2> 222561 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001
2> 222561 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
2> 222562 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer client port: /127.0.0.1:0
2> 222562 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer Starting server
2> 222563 WARN (ZkTestServer Run Thread) [] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
2> 222662 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.ZkTestServer start zk server on port: 36289
2> 222663 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222663 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222663 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222664 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222666 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222667 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222667 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222667 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222668 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222668 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222669 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222669 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222669 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222669 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222670 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222670 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222670 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222671 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222671 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222672 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222672 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222673 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 222775 INFO (jetty-launcher-2709-thread-2) [] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
2> 222775 INFO (jetty-launcher-2709-thread-1) [] o.a.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
2> 222775 INFO (jetty-launcher-2709-thread-2) [] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
2> 222775 INFO (jetty-launcher-2709-thread-1) [] o.a.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
2> 222775 INFO (jetty-launcher-2709-thread-2) [] o.e.j.s.Server jetty-12.0.27; built: 2025-09-10T23:47:49.595Z; git: 3569a3e83ad136ee44e26b370b74c1c5e9f33e61; jvm 21.0.4+7-LTS
2> 222775 INFO (jetty-launcher-2709-thread-1) [] o.e.j.s.Server jetty-12.0.27; built: 2025-09-10T23:47:49.595Z; git: 3569a3e83ad136ee44e26b370b74c1c5e9f33e61; jvm 21.0.4+7-LTS
2> 222777 INFO (jetty-launcher-2709-thread-2) [] o.e.j.s.DefaultSessionIdManager Session workerName=node0
2> 222777 INFO (jetty-launcher-2709-thread-1) [] o.e.j.s.DefaultSessionIdManager Session workerName=node0
2> 222777 WARN (jetty-launcher-2709-thread-2) [] o.e.j.e.s.ServletContextHandler BaseResource file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./ is aliased to file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/ in oeje10s.ServletContextHandler@1646598c{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./,a=STOPPED,h=oeje10s.SessionHandler@110e2c14{STOPPED}}. May not be supported in future releases.
2> 222777 WARN (jetty-launcher-2709-thread-1) [] o.e.j.e.s.ServletContextHandler BaseResource file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./ is aliased to file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/ in oeje10s.ServletContextHandler@d2f53c4{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./,a=STOPPED,h=oeje10s.SessionHandler@3d9ca8c1{STOPPED}}. May not be supported in future releases.
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.e.j.s.h.ContextHandler /solr Base Resource is an alias: file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./ -> file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.e.j.s.h.ContextHandler /solr Base Resource is an alias: file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/./ -> file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.e.j.s.h.ContextHandler Started oeje10s.ServletContextHandler@d2f53c4{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/,a=AVAILABLE,h=oeje10s.SessionHandler@3d9ca8c1{STARTED}}
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.e.j.s.h.ContextHandler Started oeje10s.ServletContextHandler@1646598c{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/,a=AVAILABLE,h=oeje10s.SessionHandler@110e2c14{STARTED}}
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.e.JettySolrRunner Jetty properties: {hostPort=45343, zkHost=127.0.0.1:36289/solr}
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.e.JettySolrRunner Jetty properties: {hostPort=33273, zkHost=127.0.0.1:36289/solr}
2> 222778 ERROR (jetty-launcher-2709-thread-1) [] o.a.s.u.StartupLoggingUtils Missing Java Option solr.logs.dir. Logging may be missing or incomplete.
2> 222778 ERROR (jetty-launcher-2709-thread-2) [] o.a.s.u.StartupLoggingUtils Missing Java Option solr.logs.dir. Logging may be missing or incomplete.
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 10.0.1
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider ___ _ Welcome to Apache Solr™ version 10.0.1
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider / __| ___| |_ _ Starting in cloud mode on port null
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider \__ \/ _ \ | '_| Install dir: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-09-03T10:18:37.822621308Z
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider |___/\___/_|_| Start time: 2026-09-03T10:18:37.822643005Z
2> 222778 INFO (jetty-launcher-2709-thread-1) [] o.a.s.s.CoreContainerProvider Solr Home: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node1 (source: servlet config: solr.solr.home)
2> 222778 INFO (jetty-launcher-2709-thread-2) [] o.a.s.s.CoreContainerProvider Solr Home: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node2 (source: servlet config: solr.solr.home)
2> 222778 WARN (jetty-launcher-2709-thread-1) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222778 WARN (jetty-launcher-2709-thread-2) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222779 WARN (jetty-launcher-2709-thread-1) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222779 WARN (jetty-launcher-2709-thread-2) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222779 INFO (jetty-launcher-2709-thread-1) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222779 INFO (jetty-launcher-2709-thread-2) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222780 INFO (jetty-launcher-2709-thread-2) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222780 INFO (jetty-launcher-2709-thread-1) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222781 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222781 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222782 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222782 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222782 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222782 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222782 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 222782 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 222883 INFO (jetty-launcher-2709-thread-2) [] o.a.s.c.SolrXmlConfig Loading solr.xml from /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node2/solr.xml
2> 222883 INFO (jetty-launcher-2709-thread-1) [] o.a.s.c.SolrXmlConfig Loading solr.xml from /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node1/solr.xml
2> 222885 INFO (jetty-launcher-2709-thread-2) [] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
2> 222885 INFO (jetty-launcher-2709-thread-1) [] o.a.s.c.SolrXmlConfig Metrics collection is disabled.
2> 222892 INFO (jetty-launcher-2709-thread-1) [] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36289/solr
2> 222893 WARN (jetty-launcher-2709-thread-1) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222893 WARN (jetty-launcher-2709-thread-1) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222893 INFO (jetty-launcher-2709-thread-2) [] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36289/solr
2> 222893 WARN (jetty-launcher-2709-thread-2) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222893 INFO (jetty-launcher-2709-thread-1) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222893 WARN (jetty-launcher-2709-thread-2) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 222893 INFO (jetty-launcher-2709-thread-2) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222894 INFO (jetty-launcher-2709-thread-1) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222895 INFO (jetty-launcher-2709-thread-2) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222895 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222895 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 222896 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222896 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222896 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222896 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 222896 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 222896 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 222997 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222997 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 222999 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 222999 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 223000 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 223000 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 223001 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223001 INFO (jetty-launcher-2709-thread-2-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223001 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223001 INFO (jetty-launcher-2709-thread-1-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223018 WARN (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 223018 WARN (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 223021 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.ZkController The Overseer is enabled. It will process all cluster commands & state updates.
2> 223021 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.c.ZkController The Overseer is enabled. It will process all cluster commands & state updates.
2> 223024 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45343_solr
2> 223024 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.Overseer Overseer (id=72149070281965576-127.0.0.1:45343_solr-n_0000000000) starting
2> 223025 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/127.0.0.1:33273_solr
2> 223026 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
2> 223026 INFO (zkCallback-2740-thread-1) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
2> 223028 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.ZkController Publish node=127.0.0.1:45343_solr as DOWN
2> 223029 INFO (OverseerStateUpdate-72149070281965576-127.0.0.1:45343_solr-n_0000000000) [n:127.0.0.1:45343_solr] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:45343_solr
2> 223029 WARN (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
2> 223030 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.ZkController Register node as live in ZooKeeper: /live_nodes/127.0.0.1:45343_solr
2> 223031 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
2> 223031 INFO (zkCallback-2740-thread-1) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
2> 223033 WARN (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
2> 223051 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node1
2> 223084 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 223098 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.e.j.e.s.ServletContextHandler Started oeje10s.ServletContextHandler@d2f53c4{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/,a=AVAILABLE,h=oeje10s.SessionHandler@3d9ca8c1{STARTED}}
2> 223098 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.e.j.s.AbstractConnector Started ServerConnector@2ee6a946{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:45343}
2> 223099 INFO (jetty-launcher-2709-thread-1) [n:127.0.0.1:45343_solr] o.e.j.s.Server Started oejs.Server@58f397da{STARTING}[12.0.27,sto=15000] @223120ms
2> 223100 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node2
2> 223133 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 223147 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.e.j.e.s.ServletContextHandler Started oeje10s.ServletContextHandler@1646598c{/solr,/solr,b=file:///home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/tmp/tests-cwd/,a=AVAILABLE,h=oeje10s.SessionHandler@110e2c14{STARTED}}
2> 223147 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.e.j.s.AbstractConnector Started ServerConnector@42dee1c7{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:33273}
2> 223147 INFO (jetty-launcher-2709-thread-2) [n:127.0.0.1:33273_solr] o.e.j.s.Server Started oejs.Server@4aea87b0{STARTING}[12.0.27,sto=15000] @223168ms
2> 223148 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
2> 223148 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:45343_solr
2> 223148 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 223148 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 223149 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 223150 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 223150 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 223151 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223151 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223152 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
2> 223153 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36289/solr ready
2> 223153 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.MiniSolrCloudCluster waitForNode: 127.0.0.1:33273_solr
2> 223153 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 223153 WARN (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 223153 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Starting
2> 223154 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker) [] o.a.c.f.i.CuratorFrameworkImpl Default schema
2> 223155 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
2> 223156 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223156 INFO (SUITE-LeaderTragicEventTest-seed#[6316115B34DB0BF8]-worker-EventThread) [] o.a.c.f.i.EnsembleTracker New config event received: {}
2> 223159 INFO (Curator-Framework-0) [] o.a.c.f.i.CuratorFrameworkImpl backgroundOperationsLoop exiting
2> 223265 INFO (TEST-LeaderTragicEventTest.testLeaderFailsOver-seed#[6316115B34DB0BF8]) [] o.a.s.SolrTestCaseJ4 ###Starting testLeaderFailsOver
2> 223271 INFO (OverseerThreadFactory-2750-thread-1) [ c:testLeaderFailsOver t:null-13498] o.a.s.c.a.c.CreateCollectionCmd Create collection testLeaderFailsOver
2> 223271 INFO (OverseerThreadFactory-2750-thread-1) [ c:testLeaderFailsOver t:null-13498] o.a.s.c.a.c.CreateCollectionCmd solr.cloud.prs.enabled : true and collection prs : null, isPRS : true
2> 223276 INFO (OverseerThreadFactory-2750-thread-1) [ c:testLeaderFailsOver t:null-13498] o.a.s.c.o.SliceMutator createReplica() {
2> "core":"testLeaderFailsOver_shard1_replica_n1",
2> "node_name":"127.0.0.1:33273_solr",
2> "base_url":"http://127.0.0.1:33273/solr",
2> "collection":"testLeaderFailsOver",
2> "shard":"shard1",
2> "state":"down",
2> "type":"NRT",
2> "operation":"ADDREPLICA",
2> "waitForFinalState":"false"}
2> 223278 INFO (OverseerThreadFactory-2750-thread-1) [ c:testLeaderFailsOver t:null-13498] o.a.s.c.o.SliceMutator createReplica() {
2> "core":"testLeaderFailsOver_shard1_replica_n3",
2> "node_name":"127.0.0.1:45343_solr",
2> "base_url":"http://127.0.0.1:45343/solr",
2> "collection":"testLeaderFailsOver",
2> "shard":"shard1",
2> "state":"down",
2> "type":"NRT",
2> "operation":"ADDREPLICA",
2> "waitForFinalState":"false"}
2> 223282 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.h.a.a.CreateCore core create command "org.apache.solr.client.api.model.CreateCoreParams@5286f62b"
2> 223282 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.h.a.a.CreateCore core create command "org.apache.solr.client.api.model.CreateCoreParams@465896a4"
2> 223289 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.SolrConfig Using Lucene MatchVersion: 10.3.2
2> 223289 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.SolrConfig Using Lucene MatchVersion: 10.3.2
2> 223292 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.s.IndexSchema Schema name=minimal
2> 223292 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.s.IndexSchema Schema name=minimal
2> 223292 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.s.IndexSchema Loaded schema minimal/1.7 with uniqueid field id
2> 223292 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.CoreContainer Creating SolrCore 'testLeaderFailsOver_shard1_replica_n3' using configuration from configset config
2> 223292 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.s.IndexSchema Loaded schema minimal/1.7 with uniqueid field id
2> 223292 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.CoreContainer Creating SolrCore 'testLeaderFailsOver_shard1_replica_n1' using configuration from configset config
2> 223292 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.SolrCore Opening new SolrCore at [/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node1/testLeaderFailsOver_shard1_replica_n3], dataDir=[/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node1/testLeaderFailsOver_shard1_replica_n3/data/]
2> 223293 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.SolrCore Opening new SolrCore at [/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node2/testLeaderFailsOver_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/build/tmp/tests-tmp/org.apache.solr.cloud.LeaderTragicEventTest_6316115B34DB0BF8-001/tempDir-001/node2/testLeaderFailsOver_shard1_replica_n1/data/]
2> 223322 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 223322 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 223326 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
2> 223326 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
2> 223326 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.u.CommitTracker Hard AutoCommit: disabled
2> 223326 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.u.CommitTracker Soft AutoCommit: disabled
2> 223326 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
2> 223326 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
2> 223326 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.CommitTracker Hard AutoCommit: disabled
2> 223326 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.CommitTracker Soft AutoCommit: disabled
2> 223329 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
2> 223329 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
2> 223329 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
2> 223330 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
2> 223330 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
2> 223330 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
2> 223330 INFO (searcherExecutor-2768-thread-1-processing-127.0.0.1:33273_solr testLeaderFailsOver_shard1_replica_n1 null-13498 testLeaderFailsOver shard1 core_node2) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms
2> 223331 INFO (searcherExecutor-2766-thread-1-processing-127.0.0.1:45343_solr testLeaderFailsOver_shard1_replica_n3 null-13498 testLeaderFailsOver shard1 core_node4) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms
2> 223334 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
2> 223334 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testLeaderFailsOver/terms/shard1 to Terms{values={core_node4=0}, version=0} for registerTerm
2> 223335 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testLeaderFailsOver/leaders/shard1
2> 223336 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testLeaderFailsOver/terms/shard1 to Terms{values={core_node2=0, core_node4=0}, version=1} for registerTerm
2> 223336 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testLeaderFailsOver/leaders/shard1
2> 223343 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
2> 223343 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
2> 223343 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/
2> 223343 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n3 url=http://127.0.0.1:45343/solr START replicas=[http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/] nUpdates=100
2> 223344 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n3 url=http://127.0.0.1:45343/solr DONE. We have no versions. sync failed.
2> 223344 INFO (qtp578730329-4673-null-13498) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13498] o.a.s.c.S.Request path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin} status=0 QTime=0
2> 223345 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
2> 223345 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
2> 223345 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testLeaderFailsOver/leaders/shard1/leader after winning as /collections/testLeaderFailsOver/leader_elect/shard1/election/72149070281965576-core_node4-n_0000000000
2> 223347 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/ shard1
2> 223450 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 223451 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13498] o.a.s.c.ZkController I am the leader, no recovery necessary
2> 223454 INFO (qtp460781183-4668-null-13498) [n:127.0.0.1:45343_solr t:null-13498] o.a.s.s.HttpSolrCall [admin] path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testLeaderFailsOver_shard1_replica_n3&action=CREATE&numShards=1&collection=testLeaderFailsOver&shard=shard1&wt=javabin&replicaType=NRT} status=0 QTime=171
2> 223554 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 224348 INFO (qtp578730329-4671-null-13498) [n:127.0.0.1:33273_solr t:null-13498] o.a.s.s.HttpSolrCall [admin] path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=testLeaderFailsOver_shard1_replica_n1&action=CREATE&numShards=1&collection=testLeaderFailsOver&shard=shard1&wt=javabin&replicaType=NRT} status=0 QTime=1066
2> 224351 INFO (qtp578730329-4665-null-13497) [n:127.0.0.1:33273_solr c:testLeaderFailsOver t:null-13497] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
2> 224448 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 224448 INFO (zkCallback-2740-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 224449 INFO (qtp578730329-4665-null-13497) [n:127.0.0.1:33273_solr c:testLeaderFailsOver t:null-13497] o.a.s.s.HttpSolrCall [admin] path=/admin/collections params={collection.configName=config&name=testLeaderFailsOver&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin} status=0 QTime=1182
2> 224450 INFO (TEST-LeaderTragicEventTest.testLeaderFailsOver-seed#[6316115B34DB0BF8]) [] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testLeaderFailsOver
2> 224456 INFO (qtp460781183-4672-null-13499) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13499] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testLeaderFailsOver/terms/shard1 to Terms{values={core_node2=1, core_node4=1}, version=2} for ensureHighestTermsAreNotZero
2> 224459 INFO (qtp578730329-4669-null-13499) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13499] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/&wt=javabin}{add=[1 (1875305530128334848)]} 0 1
2> 224459 INFO (qtp460781183-4672-null-13499) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13499] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={_stateVer_=testLeaderFailsOver:5&wt=javabin}{add=[1 (1875305530128334848)]} 0 6
2> 224463 INFO (searcherExecutor-2766-thread-1-processing-127.0.0.1:45343_solr testLeaderFailsOver_shard1_replica_n3 null-13500 testLeaderFailsOver shard1 core_node4) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13500] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_cache_size, description=Current number cache entries, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_ram_used, description=RAM bytes used by cache, unit=By, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_warmup_time, description=Cache warmup time (most recent), unit=ms, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_ops, description=Number of cumulative cache operations (inserts and evictions), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_lookups, description=Number of cumulative cache lookup results (hits and misses), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> 224463 INFO (searcherExecutor-2768-thread-1-processing-127.0.0.1:33273_solr testLeaderFailsOver_shard1_replica_n1 null-13500 testLeaderFailsOver shard1 core_node2) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13500] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_live_docs_cache, description=LiveDocs cache metrics, unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_num_docs, description=Number of live docs in the index, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_docs, description=Total number of docs in the index (including deletions), unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_version, description=Lucene index version, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_cache_warmup_time, description=Cache warmup time (most recent), unit=ms, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_lookups, description=Number of cumulative cache lookup results (hits and misses), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_ops, description=Number of cumulative cache operations (inserts and evictions), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_size, description=Current number cache entries, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_ram_used, description=RAM bytes used by cache, unit=By, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_live_docs_cache, description=LiveDocs cache metrics, unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_num_docs, description=Number of live docs in the index, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_docs, description=Total number of docs in the index (including deletions), unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:39 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_index_version, description=Lucene index version, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> 224464 INFO (qtp578730329-4673-null-13500) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13500] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/&commit_end_point=replicas&wt=javabin&expungeDeletes=false}{commit=} 0 2
2> 224464 INFO (qtp460781183-4674-null-13500) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13500] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={_stateVer_=testLeaderFailsOver:5&commit=true&wt=javabin}{commit=} 0 3
2> 224465 INFO (TEST-LeaderTragicEventTest.testLeaderFailsOver-seed#[6316115B34DB0BF8]) [] o.a.s.c.LeaderTragicEventTest Will crash leader : core_node4:{
2> "core":"testLeaderFailsOver_shard1_replica_n3",
2> "leader":"true",
2> "node_name":"127.0.0.1:45343_solr",
2> "base_url":"http://127.0.0.1:45343/solr",
2> "state":"active",
2> "type":"NRT",
2> "force_set_state":"false"}
2> 224470 WARN (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.c.ZkController Leader testLeaderFailsOver:core_node4 met tragic exception, give up its leadership
2> 224471 INFO (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testLeaderFailsOver/leaders/shard1
2> 224472 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
2> 224473 ERROR (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.u.SolrIndexWriter Error closing IndexWriter
2> =>java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot flush
2> at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:4288)
2>
2> 224474 INFO (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
2> 224474 ERROR (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.h.RequestHandlerBase Server exception
2> =>org.apache.solr.common.SolrException: Random tragedy fail
2> at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:407)
2>
2> 224474 INFO (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.c.S.Request path=/update params={commit=true&wt=javabin} status=500 QTime=5
2> 224474 ERROR (qtp460781183-4668-null-13501) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13501] o.a.s.s.HttpSolrCall 500 Exception
2> =>org.apache.solr.common.SolrException: Random tragedy fail
2> at org.apache.solr.util.TestInjection.injectLeaderTragedy(TestInjection.java:407)
2>
2> 224477 INFO (TEST-LeaderTragicEventTest.testLeaderFailsOver-seed#[6316115B34DB0BF8]) [] o.a.s.c.LeaderTragicEventTest Tragic event triggered on attempt 1
2> 224477 INFO (TEST-LeaderTragicEventTest.testLeaderFailsOver-seed#[6316115B34DB0BF8]) [] o.a.s.c.SolrCloudTestCase waitForState (testLeaderFailsOver): Now waiting for new replica to become leader
2> 224575 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 224575 INFO (zkCallback-2759-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 224575 INFO (zkCallback-2740-thread-2) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 226972 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/
2> 226972 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n1 url=http://127.0.0.1:33273/solr START replicas=[http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/] nUpdates=100
2> 226982 INFO (qtp460781183-4664-null-13502) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13502] o.a.s.c.S.Request path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin} status=0 QTime=6
2> 226982 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n1 url=http://127.0.0.1:33273/solr Received 1 versions from http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/ fingerprint:null
2> 226983 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n1 url=http://127.0.0.1:33273/solr No additional versions requested. ourHighThreshold=1875305530128334848 otherLowThreshold=1875305530128334848 ourHighest=1875305530128334848 otherHighest=1875305530128334848
2> 226983 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n1 url=http://127.0.0.1:33273/solr DONE. sync succeeded
2> 226983 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
2> 226983 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/: try and ask http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/ to sync
2> 226984 INFO (qtp460781183-4666-null-13503) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13503] o.a.s.u.PeerSync PeerSync: core=testLeaderFailsOver_shard1_replica_n3 url=http://127.0.0.1:45343/solr START replicas=[http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/] nUpdates=100
2> 226988 INFO (qtp578730329-4671-null-13503) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13503] o.a.s.u.IndexFingerprint IndexFingerprint millis:3.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=1875305530128334848, maxInHash=1875305530128334848, versionsHash=-5154674787826198193, numVersions=1, numDocs=1, maxDoc=1}
2> 226988 INFO (qtp460781183-4666-null-13503) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13503] o.a.s.u.IndexFingerprint IndexFingerprint millis:3.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=1875305530128334848, maxInHash=1875305530128334848, versionsHash=-5154674787826198193, numVersions=1, numDocs=1, maxDoc=1}
2> 226988 INFO (qtp578730329-4671-null-13503) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13503] o.a.s.c.S.Request path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin} status=0 QTime=3
2> 226989 INFO (qtp460781183-4666-null-13503) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13503] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync
2> 226989 INFO (qtp460781183-4666-null-13503) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13503] o.a.s.c.S.Request path=/get params={distrib=false&qt=/get&getVersions=100&sync=http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/&wt=javabin} status=0 QTime=5
2> 226989 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/: sync completed with http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3
2> 226989 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testLeaderFailsOver/leaders/shard1/leader after winning as /collections/testLeaderFailsOver/leader_elect/shard1/election/72149070281965575-core_node2-n_0000000001
2> 226992 INFO (zkCallback-2740-thread-1) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/ shard1
2> 226993 INFO (zkCallback-2741-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 226993 INFO (zkCallback-2740-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 226993 INFO (zkCallback-2759-thread-1) [] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testLeaderFailsOver/state.json zxid: -1] for collection [testLeaderFailsOver] has occurred - updating... (live nodes size: [2])
2> 227002 INFO (qtp460781183-4674-null-13504) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13504] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:33273/solr/testLeaderFailsOver_shard1_replica_n1/&wt=javabin}{add=[2 (1875305532794863616)]} 0 0
2> 227002 INFO (qtp578730329-4665-null-13504) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13504] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:45343/solr/testLeaderFailsOver_shard1_replica_n3/&wt=javabin}{add=[2 (1875305532794863616)]} 0 4
2> 227003 INFO (qtp460781183-4668-null-13504) [n:127.0.0.1:45343_solr c:testLeaderFailsOver s:shard1 r:core_node4 x:testLeaderFailsOver_shard1_replica_n3 t:null-13504] o.a.s.u.p.LogUpdateProcessorFactory path=/update params={_stateVer_=testLeaderFailsOver:5&wt=javabin}{add=[2]} 0 6
2> 227007 INFO (searcherExecutor-2768-thread-1-processing-127.0.0.1:33273_solr testLeaderFailsOver_shard1_replica_n1 null-13505 testLeaderFailsOver shard1 core_node2) [n:127.0.0.1:33273_solr c:testLeaderFailsOver s:shard1 r:core_node2 x:testLeaderFailsOver_shard1_replica_n1 t:null-13505] o.a.s.c.SolrCore Registered new searcher autowarm time: 0 ms
2> ᏚᎵ 02, 2026 11:18:42 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=[InstrumentDescriptor{name=solr_core_indexsearcher_cache_ops, description=Number of cumulative cache operations (inserts and evictions), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_warmup_time, description=Cache warmup time (most recent), unit=ms, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_ram_used, description=RAM bytes used by cache, unit=By, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_lookups, description=Number of cumulative cache lookup results (hits and misses), unit=, type=OBSERVABLE_COUNTER, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}, InstrumentDescriptor{name=solr_core_indexsearcher_cache_size, description=Current number cache entries, unit=, type=OBSERVABLE_GAUGE, valueType=LONG, advice=Advice{explicitBucketBoundaries=null, attributes=null}}]} has called close() multiple times.
2> ᏚᎵ 02, 2026 11:18:42 ᏒᎯᏱᎢᏗᏢ io.opentelemetry.sdk.internal.ThrottlingLogger doLog
2> WARNING: CallbackRegistration{instrumentDescriptors=
[...truncated too long message...]
antiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
:solr:modules:s3-repository:test (SUCCESS): 53 test(s), 1 skipped
> Task :solr:modules:s3-repository:wipeTaskTemp
> Task :solr:modules:scripting:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:modules:scripting:processResources NO-SOURCE
> Task :solr:modules:scripting:classes
> Task :solr:modules:scripting:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:modules:scripting:processTestResources
> Task :solr:modules:scripting:testClasses
> Task :solr:modules:scripting:test
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
:solr:modules:scripting:test (SUCCESS): 22 test(s), 17 skipped
> Task :solr:modules:scripting:wipeTaskTemp
> Task :solr:modules:sql:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :solr:modules:sql:copySolrCoreTestResources
> Task :solr:modules:sql:processTestResources
> Task :solr:modules:sql:testClasses
> Task :solr:modules:sql:test
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: Using incubator modules: jdk.incubator.vector
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
WARNING: A command line option has enabled the Security Manager
WARNING: The Security Manager is deprecated and will be removed in a future release
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
java.security.policy: error adding Permission, java.net.URLPermission:
java.util.ServiceConfigurationError: Locale provider adapter "CLDR"cannot be instantiated.
:solr:modules:sql:test (SUCCESS): 33 test(s)
> Task :solr:modules:sql:wipeTaskTemp
The slowest tests (exceeding 500 ms) during this run:
93.03s BasicDistributedZkTest.test (:solr:core)
67.48s TestCloudJSONFacetSKG.testRandom (:solr:core)
66.22s TestCpuAllowedLimit.testDistribLimit2 (:solr:core)
56.36s TestCpuAllowedLimit.testDistribLimit (:solr:core)
48.92s ReplicationFactorTest.test (:solr:core)
47.61s SyncSliceTest.test (:solr:core)
44.25s PeerSyncReplicationTest.test (:solr:core)
42.25s TestRandomFaceting.testRandomFaceting (:solr:core)
41.59s TestInPlaceUpdatesDistrib.test (:solr:core)
41.25s UnloadDistributedZkTest.test (:solr:core)
The slowest suites (exceeding 1s) during this run:
128.23s TestCpuAllowedLimit (:solr:core)
93.30s BasicDistributedZkTest (:solr:core)
75.88s TestCoordinatorRole (:solr:core)
72.42s TestCloudJSONFacetSKG (:solr:core)
71.59s TestRecovery (:solr:core)
70.03s KnnQParserTest (:solr:core)
62.15s TestPullReplica (:solr:core)
61.64s TestCloudConsistency (:solr:core)
61.33s TestTlogReplica (:solr:core)
58.29s MultiThreadedOCPTest (:solr:core)
ERROR: The following test(s) have failed:
- org.apache.solr.cloud.LeaderTragicEventTest (:solr:core)
Test history: https://develocity.apache.org/scans/tests?search.rootProjectNames=solr-root&tests.container=org.apache.solr.cloud.LeaderTragicEventTest
Test output: /home/jenkins/jenkins-agent/workspace/Solr/Solr-Test-10.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.LeaderTragicEventTest.txt
Reproduce with: ./gradlew :solr:core:test --tests "org.apache.solr.cloud.LeaderTragicEventTest" -Ptests.haltonfailure=false "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC -XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" -Ptests.seed=6316115B34DB0BF8 -Ptests.multiplier=2 -Ptests.useSecurityManager=true -Ptests.badapples=false -Ptests.file.encoding=US-ASCII
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.10/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD SUCCESSFUL in 40m 29s
153 actionable tasks: 153 executed
Publishing build scan...
The Develocity server (develocity.apache.org) rejected the access key with prefix '7x3jzizm4zpygv7psbkg6byvm4'.
Your credential has expired.
Build step 'Invoke Gradle script' changed build result to SUCCESS
Archiving artifacts
‘**/*.events’ doesn’t match anything: ‘**’ exists but not ‘**/*.events’
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
[Checks API] No suitable checks publisher found.
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)