You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Markus Jelsma <ma...@openindex.io> on 2019/08/21 10:28:48 UTC
StackOverflowError leader election on 8.2.0
Hello,
Looking this up i found SOLR-5692, but that was solved a lifetime ago, so just checking if this is a familiar error and one i missing in Jira:
A client's Solr 8.2.0 cluster brought us the next StackOverflowError while running 8.2.0 on Java 8:
Exception in thread "coreZkRegister-1-thread-3" java.lang.StackOverflowError
at org.apache.logging.log4j.ThreadContext.getImmutableContext(ThreadContext.java:352)
at org.apache.logging.log4j.core.impl.ThreadContextDataInjector$ForDefaultThreadContextMap.injectContextData(ThreadContextDataInjector.java:66)
at org.apache.logging.log4j.core.impl.Log4jLogEvent.createContextData(Log4jLogEvent.java:473)
at org.apache.logging.log4j.core.impl.Log4jLogEvent.<init>(Log4jLogEvent.java:331)
at org.apache.logging.log4j.core.impl.DefaultLogEventFactory.createEvent(DefaultLogEventFactory.java:54)
at org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:404)
at org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:63)
at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:146)
at org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2170)
at org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2125)
at org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2108)
at org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2007)
at org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1866)
at org.apache.logging.slf4j.Log4jLogger.info(Log4jLogger.java:179)
at org.apache.solr.update.PeerSync.sync(PeerSync.java:172)
at org.apache.solr.cloud.SyncStrategy.syncWithReplicas(SyncStrategy.java:187)
at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:131)
at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:109)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:400)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
..... it repeats hundreds of times
at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1479)
at org.apache.solr.cloud.ZkController.register(ZkController.java:1219)
at org.apache.solr.cloud.ZkController.register(ZkController.java:1171)
at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:191)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Re: StackOverflowError leader election on 8.2.0
Posted by Mikhail Khludnev <mk...@apache.org>.
> Looking this up i found SOLR-5692, but that was solved a lifetime ago,
It wasn't.
https://issues.apache.org/jira/browse/SOLR-5692?focusedCommentId=14556876&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-14556876
On Wed, Aug 21, 2019 at 1:29 PM Markus Jelsma <ma...@openindex.io>
wrote:
> Hello,
>
> Looking this up i found SOLR-5692, but that was solved a lifetime ago, so
> just checking if this is a familiar error and one i missing in Jira:
>
> A client's Solr 8.2.0 cluster brought us the next StackOverflowError while
> running 8.2.0 on Java 8:
>
> Exception in thread "coreZkRegister-1-thread-3"
> java.lang.StackOverflowError
> at
> org.apache.logging.log4j.ThreadContext.getImmutableContext(ThreadContext.java:352)
> at
> org.apache.logging.log4j.core.impl.ThreadContextDataInjector$ForDefaultThreadContextMap.injectContextData(ThreadContextDataInjector.java:66)
> at
> org.apache.logging.log4j.core.impl.Log4jLogEvent.createContextData(Log4jLogEvent.java:473)
> at
> org.apache.logging.log4j.core.impl.Log4jLogEvent.<init>(Log4jLogEvent.java:331)
> at
> org.apache.logging.log4j.core.impl.DefaultLogEventFactory.createEvent(DefaultLogEventFactory.java:54)
> at
> org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:404)
> at
> org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:63)
> at org.apache.logging.log4j.core.Logger.logMessage(Logger.java:146)
> at
> org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2170)
> at
> org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2125)
> at
> org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2108)
> at
> org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2007)
> at
> org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1866)
> at org.apache.logging.slf4j.Log4jLogger.info(Log4jLogger.java:179)
> at org.apache.solr.update.PeerSync.sync(PeerSync.java:172)
> at
> org.apache.solr.cloud.SyncStrategy.syncWithReplicas(SyncStrategy.java:187)
> at
> org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:131)
> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:109)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:400)
> at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
> at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
> at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
> at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
> at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
> at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
> at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
> at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218)
>
> ..... it repeats hundreds of times
>
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:703)
> at
> org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:449)
> at
> org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:172)
> at
> org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:137)
> at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:309)
> at
> org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1479)
> at
> org.apache.solr.cloud.ZkController.register(ZkController.java:1219)
> at
> org.apache.solr.cloud.ZkController.register(ZkController.java:1171)
> at
> org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:191)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
>
--
Sincerely yours
Mikhail Khludnev