You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Matthias (Jira)" <ji...@apache.org> on 2021/05/05 16:02:00 UTC
[jira] [Updated] (FLINK-22577)
KubernetesLeaderElectionAndRetrievalITCase is failing
[ https://issues.apache.org/jira/browse/FLINK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias updated FLINK-22577:
-----------------------------
Description:
{{KubernetesLeaderElectionAndRetrievalITCase}} is failing constantly. Running it locally results in an {{AssertionError}}:
{code}
3069 [KubernetesLeaderElector-ExecutorService-thread-1] DEBUG io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector [] - Loop thread interrupted
java.lang.InterruptedException: null
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) ~[?:1.8.0_265]
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) ~[?:1.8.0_265]
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231) ~[?:1.8.0_265]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.loop(LeaderElector.java:200) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.renewWithTimeout(LeaderElector.java:100) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:71) ~[kubernetes-client-4.9.2.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
3078 [KubernetesLeaderElector-ExecutorService-thread-1] ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: Thread 'KubernetesLeaderElector-ExecutorService-thread-1' produced an uncaught exception. Stopping the process...
java.lang.AssertionError: null
at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver.writeLeaderInformation(KubernetesLeaderElectionDriver.java:130) ~[classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.lambda$onRevokeLeadership$1(TestingLeaderElectionEventHandler.java:69) ~[test-classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.waitForInitialization(TestingLeaderElectionEventHandler.java:93) ~[test-classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.onRevokeLeadership(TestingLeaderElectionEventHandler.java:66) ~[test-classes/:?]
at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver$LeaderCallbackHandlerImpl.notLeader(KubernetesLeaderElectionDriver.java:202) ~[classes/:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderCallbacks.onStopLeading(LeaderCallbacks.java:38) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:72) ~[kubernetes-client-4.9.2.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
{code}
The failure never popped up due to FLINK-22564
was:
{{KubernetesLeaderElectionAndRetrievalITCase}} is failing constantly. Running it locally results in an {{AssertionError}}:
{code}
3069 [KubernetesLeaderElector-ExecutorService-thread-1] DEBUG io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector [] - Loop thread interrupted
java.lang.InterruptedException: null
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) ~[?:1.8.0_265]
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) ~[?:1.8.0_265]
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231) ~[?:1.8.0_265]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.loop(LeaderElector.java:200) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.renewWithTimeout(LeaderElector.java:100) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:71) ~[kubernetes-client-4.9.2.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
3078 [KubernetesLeaderElector-ExecutorService-thread-1] ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: Thread 'KubernetesLeaderElector-ExecutorService-thread-1' produced an uncaught exception. Stopping the process...
java.lang.AssertionError: null
at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver.writeLeaderInformation(KubernetesLeaderElectionDriver.java:130) ~[classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.lambda$onRevokeLeadership$1(TestingLeaderElectionEventHandler.java:69) ~[test-classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.waitForInitialization(TestingLeaderElectionEventHandler.java:93) ~[test-classes/:?]
at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.onRevokeLeadership(TestingLeaderElectionEventHandler.java:66) ~[test-classes/:?]
at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver$LeaderCallbackHandlerImpl.notLeader(KubernetesLeaderElectionDriver.java:202) ~[classes/:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderCallbacks.onStopLeading(LeaderCallbacks.java:38) ~[kubernetes-client-4.9.2.jar:?]
at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:72) ~[kubernetes-client-4.9.2.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
{code}
> KubernetesLeaderElectionAndRetrievalITCase is failing
> -----------------------------------------------------
>
> Key: FLINK-22577
> URL: https://issues.apache.org/jira/browse/FLINK-22577
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Kubernetes, Runtime / Coordination
> Affects Versions: 1.13.0, 1.14.0, 1.12.3
> Reporter: Matthias
> Priority: Critical
>
> {{KubernetesLeaderElectionAndRetrievalITCase}} is failing constantly. Running it locally results in an {{AssertionError}}:
> {code}
> 3069 [KubernetesLeaderElector-ExecutorService-thread-1] DEBUG io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector [] - Loop thread interrupted
> java.lang.InterruptedException: null
> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) ~[?:1.8.0_265]
> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) ~[?:1.8.0_265]
> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231) ~[?:1.8.0_265]
> at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.loop(LeaderElector.java:200) ~[kubernetes-client-4.9.2.jar:?]
> at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.renewWithTimeout(LeaderElector.java:100) ~[kubernetes-client-4.9.2.jar:?]
> at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:71) ~[kubernetes-client-4.9.2.jar:?]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
> 3078 [KubernetesLeaderElector-ExecutorService-thread-1] ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: Thread 'KubernetesLeaderElector-ExecutorService-thread-1' produced an uncaught exception. Stopping the process...
> java.lang.AssertionError: null
> at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver.writeLeaderInformation(KubernetesLeaderElectionDriver.java:130) ~[classes/:?]
> at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.lambda$onRevokeLeadership$1(TestingLeaderElectionEventHandler.java:69) ~[test-classes/:?]
> at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.waitForInitialization(TestingLeaderElectionEventHandler.java:93) ~[test-classes/:?]
> at org.apache.flink.runtime.leaderelection.TestingLeaderElectionEventHandler.onRevokeLeadership(TestingLeaderElectionEventHandler.java:66) ~[test-classes/:?]
> at org.apache.flink.kubernetes.highavailability.KubernetesLeaderElectionDriver$LeaderCallbackHandlerImpl.notLeader(KubernetesLeaderElectionDriver.java:202) ~[classes/:?]
> at io.fabric8.kubernetes.client.extended.leaderelection.LeaderCallbacks.onStopLeading(LeaderCallbacks.java:38) ~[kubernetes-client-4.9.2.jar:?]
> at io.fabric8.kubernetes.client.extended.leaderelection.LeaderElector.run(LeaderElector.java:72) ~[kubernetes-client-4.9.2.jar:?]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_265]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_265]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
> {code}
> The failure never popped up due to FLINK-22564
--
This message was sent by Atlassian Jira
(v8.3.4#803005)