You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2021/05/20 13:56:03 UTC
[GitHub] [flink] XComp edited a comment on pull request #15945: [FLINK-22688][runtime] Eases assertion on ExceptionHistoryEntry
XComp edited a comment on pull request #15945:
URL: https://github.com/apache/flink/pull/15945#issuecomment-844846086
We had this problem come up in another thread of @Airblader : The failure that might have also caused the issue in FLINK-22688 is that the Task gets scheduled but the TaskManager does not confirm the slot allocation due to network issues or the TaskManager becoming unavailable. We run into a slot request timeout triggering a `NoResourceAvailableException` for the job. The `TaskManagerLocation` was not set in that case, yet.
The corresponding stacktrace looks like that:
```
2021-05-20 07:26:01,797 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TableSourceScan(table=[[vvp, default, X]], fields=[id, ts]) -> WatermarkAssigner(rowtime=[ts], watermark=[ts]) -> Calc(select=[id, ts, 1 AS EXPR$2]) -> NotNullEnforcer(fields=[EXPR$2]) -> Sink: Collect table sink (1/1) (9021f1bcfe25206761e553828b063614) switched from SCHEDULED to FAILED on [unassigned resource].
java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_292]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_292]
at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge$PendingRequest.failRequest(DeclarativeSlotPoolBridge.java:532) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.cancelPendingRequests(DeclarativeSlotPoolBridge.java:128) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.failPendingRequests(DeclarativeSlotPoolBridge.java:360) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.notifyNotEnoughResourcesAvailable(DeclarativeSlotPoolBridge.java:351) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.jobmaster.JobMaster.notifyNotEnoughResourcesAvailable(JobMaster.java:816) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_292]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_292]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_292]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:301) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:212) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.actor.Actor.aroundReceive(Actor.scala:517) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.actor.Actor.aroundReceive$(Actor.scala:515) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.actor.ActorCell.invoke(ActorCell.scala:561) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.Mailbox.run(Mailbox.scala:225) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources.
at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.failPendingRequests(DeclarativeSlotPoolBridge.java:356) ~[flink-dist_2.12-1.13.0-stream1-SNAPSHOT.jar:1.13.0-stream1-SNAPSHOT]
... 30 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org