You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Matthias Pohl (Jira)" <ji...@apache.org> on 2022/11/04 16:02:00 UTC
[jira] [Comment Edited] (FLINK-29836) PulsarUnorderedSourceITCase failed due to an expected job restart not happening
[ https://issues.apache.org/jira/browse/FLINK-29836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629064#comment-17629064 ]
Matthias Pohl edited comment on FLINK-29836 at 11/4/22 4:01 PM:
----------------------------------------------------------------
{code}
java.util.concurrent.ExecutionException: org.apache.flink.util.FlinkException: Coordinator of operator 7df19f87deec5680128845fd9a6ca18d does not exist
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) ~[?:1.8.0_292]
at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:170) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:129) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.compareWithExactlyOnceSemantic(UnorderedCollectIteratorAssert.java:108) ~[flink-connector-test-utils-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.matchesRecordsFromSource(UnorderedCollectIteratorAssert.java:79) ~[flink-connector-test-utils-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.pulsar.testutils.source.UnorderedSourceTestSuiteBase.lambda$checkResultWithSemantic$0(UnorderedSourceTestSuiteBase.java:53) ~[test-classes/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_292]
at java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1632) [?:1.8.0_292]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292]
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292]
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292]
Caused by: org.apache.flink.util.FlinkException: Coordinator of operator 7df19f87deec5680128845fd9a6ca18d does not exist
at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.lambda$deliverCoordinationRequestToCoordinator$20(AdaptiveScheduler.java:726) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at java.util.Optional.orElseGet(Optional.java:267) ~[?:1.8.0_292]
at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.deliverCoordinationRequestToCoordinator(AdaptiveScheduler.java:724) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.JobMaster.sendRequestToCoordinator(JobMaster.java:572) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.JobMaster.deliverCoordinationRequestToCoordinator(JobMaster.java:890) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_292]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304) ~[?:?]
at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) ~[?:?]
at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[?:?]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) ~[?:?]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) ~[?:?]
at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) ~[?:?]
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) ~[?:?]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[?:?]
at akka.actor.Actor.aroundReceive(Actor.scala:537) ~[?:?]
at akka.actor.Actor.aroundReceive$(Actor.scala:535) ~[?:?]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) ~[?:?]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) ~[?:?]
at akka.actor.ActorCell.invoke(ActorCell.scala:548) ~[?:?]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) ~[?:?]
at akka.dispatch.Mailbox.run(Mailbox.scala:231) ~[?:?]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243) ~[?:?]
... 4 more
{code}
There has been a stacktrace like the one above. It seems to be caused by the test collecting the results for a Operator with a not existing OperatorID. Not sure though, whether that is expected or it contributed to the test failure.
was (Author: mapohl):
{quote}
java.util.concurrent.ExecutionException: org.apache.flink.util.FlinkException: Coordinator of operator 7df19f87deec5680128845fd9a6ca18d does not exist
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908) ~[?:1.8.0_292]
at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sendRequest(CollectResultFetcher.java:170) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:129) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) ~[flink-streaming-java-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.compareWithExactlyOnceSemantic(UnorderedCollectIteratorAssert.java:108) ~[flink-connector-test-utils-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.matchesRecordsFromSource(UnorderedCollectIteratorAssert.java:79) ~[flink-connector-test-utils-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.connector.pulsar.testutils.source.UnorderedSourceTestSuiteBase.lambda$checkResultWithSemantic$0(UnorderedSourceTestSuiteBase.java:53) ~[test-classes/:?]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_292]
at java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1632) [?:1.8.0_292]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292]
at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292]
at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292]
Caused by: org.apache.flink.util.FlinkException: Coordinator of operator 7df19f87deec5680128845fd9a6ca18d does not exist
at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.lambda$deliverCoordinationRequestToCoordinator$20(AdaptiveScheduler.java:726) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at java.util.Optional.orElseGet(Optional.java:267) ~[?:1.8.0_292]
at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.deliverCoordinationRequestToCoordinator(AdaptiveScheduler.java:724) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.JobMaster.sendRequestToCoordinator(JobMaster.java:572) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.JobMaster.deliverCoordinationRequestToCoordinator(JobMaster.java:890) ~[flink-runtime-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_292]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304) ~[?:?]
at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217) ~[?:?]
at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[?:?]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[?:?]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) ~[?:?]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) ~[?:?]
at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) ~[?:?]
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) ~[?:?]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[?:?]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[?:?]
at akka.actor.Actor.aroundReceive(Actor.scala:537) ~[?:?]
at akka.actor.Actor.aroundReceive$(Actor.scala:535) ~[?:?]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) ~[?:?]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) ~[?:?]
at akka.actor.ActorCell.invoke(ActorCell.scala:548) ~[?:?]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) ~[?:?]
at akka.dispatch.Mailbox.run(Mailbox.scala:231) ~[?:?]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243) ~[?:?]
... 4 more
{quote}
There has been a stacktrace like the one above. It seems to be caused by the test collecting the results for a Operator with a not existing OperatorID. Not sure though, whether that is expected or it contributed to the test failure.
> PulsarUnorderedSourceITCase failed due to an expected job restart not happening
> -------------------------------------------------------------------------------
>
> Key: FLINK-29836
> URL: https://issues.apache.org/jira/browse/FLINK-29836
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Pulsar
> Affects Versions: 1.16.0, 1.17.0, 1.15.2
> Reporter: Matthias Pohl
> Priority: Major
> Labels: test-stability
>
> [This build failed|https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=42681&view=logs&j=a5ef94ef-68c2-57fd-3794-dc108ed1c495&t=2c68b137-b01d-55c9-e603-3ff3f320364b&l=27377] due to a missing job restart:
> {code:java}
> Nov 01 02:04:20 Expecting
> Nov 01 02:04:20 <CompletableFuture[Failed with the following stack trace:
> Nov 01 02:04:20 java.lang.RuntimeException: Job restarted
> Nov 01 02:04:20 at org.apache.flink.streaming.api.operators.collect.UncheckpointedCollectResultBuffer.sinkRestarted(UncheckpointedCollectResultBuffer.java:42)
> Nov 01 02:04:20 at org.apache.flink.streaming.api.operators.collect.AbstractCollectResultBuffer.dealWithResponse(AbstractCollectResultBuffer.java:87)
> Nov 01 02:04:20 at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:147)
> Nov 01 02:04:20 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106)
> Nov 01 02:04:20 at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80)
> Nov 01 02:04:20 at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.compareWithExactlyOnceSemantic(UnorderedCollectIteratorAssert.java:108)
> Nov 01 02:04:20 at org.apache.flink.connector.testframe.utils.UnorderedCollectIteratorAssert.matchesRecordsFromSource(UnorderedCollectIteratorAssert.java:79)
> Nov 01 02:04:20 at org.apache.flink.connector.pulsar.testutils.source.UnorderedSourceTestSuiteBase.lambda$checkResultWithSemantic$0(UnorderedSourceTestSuiteBase.java:53)
> Nov 01 02:04:20 at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640)
> Nov 01 02:04:20 at java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1632)
> Nov 01 02:04:20 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
> Nov 01 02:04:20 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
> Nov 01 02:04:20 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
> Nov 01 02:04:20 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
> Nov 01 02:04:20 ]>
> Nov 01 02:04:20 to be completed within 2M.
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)