You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2022/02/03 09:33:00 UTC
[jira] [Created] (FLINK-25939) PyFlink YARN per-job on Docker test fails on AZP because it could not acquire all required slots
Till Rohrmann created FLINK-25939:
-------------------------------------
Summary: PyFlink YARN per-job on Docker test fails on AZP because it could not acquire all required slots
Key: FLINK-25939
URL: https://issues.apache.org/jira/browse/FLINK-25939
Project: Flink
Issue Type: Bug
Components: API / Python, Deployment / YARN
Affects Versions: 1.14.3
Reporter: Till Rohrmann
The test {{PyFlink YARN per-job on Docker test}} fails on AZP with:
{code}
2022-02-03T03:32:41.0643749Z Feb 03 03:32:40 2022-02-03 03:31:12,281 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: Values(tuples=[[{ 1 }, { 2 }, { 3 }]]) -> Calc(select=[f0]) -> PythonCalc(select=[add_one(f0) AS a]) -> Sink: Collect table sink (1/1) (1c3df1a51de35e44664305a57f4047a7) switched from SCHEDULED to FAILED on [unassigned resource].
2022-02-03T03:32:41.0645152Z Feb 03 03:32:40 org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:41.0647529Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0648830Z Feb 03 03:32:40 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_312]
2022-02-03T03:32:41.0649605Z Feb 03 03:32:40 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312]
2022-02-03T03:32:41.0651215Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0652935Z Feb 03 03:32:40 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0654715Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0656399Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0657987Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0659528Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0661186Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0662745Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0664203Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0665591Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0667179Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0668708Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0670130Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0671634Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0672985Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0674418Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0675750Z Feb 03 03:32:40 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0677255Z Feb 03 03:32:40 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0678551Z Feb 03 03:32:40 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0679842Z Feb 03 03:32:40 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0681294Z Feb 03 03:32:40 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0682558Z Feb 03 03:32:40 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0683425Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312]
2022-02-03T03:32:41.0684358Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_312]
2022-02-03T03:32:41.0685141Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_312]
2022-02-03T03:32:41.0685923Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_312]
2022-02-03T03:32:41.0812000Z Feb 03 03:32:40 Caused by: java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms
2022-02-03T03:32:41.0812688Z Feb 03 03:32:40 ... 29 more
2022-02-03T03:32:41.0813995Z Feb 03 03:32:40 2022-02-03 03:31:12,401 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding the results produced by task execution 1c3df1a51de35e44664305a57f4047a7.
2022-02-03T03:32:41.0815641Z Feb 03 03:32:40 2022-02-03 03:31:12,674 INFO org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy [] - Calculating tasks to restart to recover the failed task cbc357ccb763df2852fee8c4fc7d55f2_0.
2022-02-03T03:32:41.0817969Z Feb 03 03:32:40 2022-02-03 03:31:12,676 INFO org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy [] - 1 tasks should be restarted to recover the failed task cbc357ccb763df2852fee8c4fc7d55f2_0.
2022-02-03T03:32:41.0819677Z Feb 03 03:32:40 2022-02-03 03:31:12,679 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect (1470f23d8978792b87cf1e0a7989cf4b) switched from state RUNNING to FAILING.
2022-02-03T03:32:41.0820634Z Feb 03 03:32:40 org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
2022-02-03T03:32:41.0822394Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0824213Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0825865Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0827486Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0828989Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0830658Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0832414Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0834279Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0835811Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0837154Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0838502Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0839878Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0841375Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0843077Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0844689Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0845789Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_312]
2022-02-03T03:32:41.0846607Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_312]
2022-02-03T03:32:41.0847784Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_312]
2022-02-03T03:32:41.0848646Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_312]
2022-02-03T03:32:41.0849992Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0851564Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0853362Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0854985Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0856804Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0857996Z Feb 03 03:32:40 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_312]
2022-02-03T03:32:41.0858751Z Feb 03 03:32:40 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312]
2022-02-03T03:32:41.0860070Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0861689Z Feb 03 03:32:40 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0863267Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0864782Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0866340Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0867890Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0869308Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0871044Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0872567Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0873915Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0875297Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0876673Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:41.0878291Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0874317Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0876269Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0878138Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0880639Z Feb 03 03:32:40 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0882451Z Feb 03 03:32:40 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0883813Z Feb 03 03:32:40 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0885111Z Feb 03 03:32:40 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0886384Z Feb 03 03:32:40 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0889089Z Feb 03 03:32:40 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0889987Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312]
2022-02-03T03:32:42.0890746Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_312]
2022-02-03T03:32:42.0891536Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_312]
2022-02-03T03:32:42.0892314Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_312]
2022-02-03T03:32:42.0893460Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.0895114Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0895907Z Feb 03 03:32:40 ... 37 more
2022-02-03T03:32:42.0896751Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.0897825Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_312]
2022-02-03T03:32:42.0898678Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_312]
2022-02-03T03:32:42.0899517Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) ~[?:1.8.0_312]
2022-02-03T03:32:42.0900348Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_312]
2022-02-03T03:32:42.0900965Z Feb 03 03:32:40 ... 35 more
2022-02-03T03:32:42.0901701Z Feb 03 03:32:40 Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.0903725Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0904705Z Feb 03 03:32:40 ... 28 more
2022-02-03T03:32:42.0905236Z Feb 03 03:32:40 Caused by: java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms
2022-02-03T03:32:42.0906727Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0907904Z Feb 03 03:32:40 ... 28 more
2022-02-03T03:32:42.0909017Z Feb 03 03:32:40 2022-02-03 03:31:12,746 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect (1470f23d8978792b87cf1e0a7989cf4b) switched from state FAILING to FAILED.
2022-02-03T03:32:42.0909961Z Feb 03 03:32:40 org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
2022-02-03T03:32:42.0911298Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0912971Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0914486Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0915939Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0917435Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0919572Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0921312Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0923653Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0925197Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0926561Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0968725Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0971868Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0973945Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0975545Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0977473Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0978571Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_312]
2022-02-03T03:32:42.0979408Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_312]
2022-02-03T03:32:42.0980248Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_312]
2022-02-03T03:32:42.0981102Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_312]
2022-02-03T03:32:42.0983039Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0984643Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0986246Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0987851Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0989679Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0990867Z Feb 03 03:32:40 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_312]
2022-02-03T03:32:42.0991627Z Feb 03 03:32:40 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312]
2022-02-03T03:32:42.0995734Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0997413Z Feb 03 03:32:40 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.0998994Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1000526Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1002104Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1003637Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1005327Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1006945Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1008360Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1009995Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1011366Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1012739Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1014111Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1016155Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1017625Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1018908Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1020228Z Feb 03 03:32:40 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1021568Z Feb 03 03:32:40 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1023116Z Feb 03 03:32:40 at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1024539Z Feb 03 03:32:40 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1025823Z Feb 03 03:32:40 at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1027438Z Feb 03 03:32:40 at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1028318Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312]
2022-02-03T03:32:42.1029075Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_312]
2022-02-03T03:32:42.1029854Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_312]
2022-02-03T03:32:42.1030634Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_312]
2022-02-03T03:32:42.1031786Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1033432Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1034219Z Feb 03 03:32:40 ... 37 more
2022-02-03T03:32:42.1035064Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1036140Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_312]
2022-02-03T03:32:42.1037454Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_312]
2022-02-03T03:32:42.1038362Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) ~[?:1.8.0_312]
2022-02-03T03:32:42.1039401Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) ~[?:1.8.0_312]
2022-02-03T03:32:42.1040013Z Feb 03 03:32:40 ... 35 more
2022-02-03T03:32:42.1040747Z Feb 03 03:32:40 Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1042570Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1043691Z Feb 03 03:32:40 ... 28 more
2022-02-03T03:32:42.1044225Z Feb 03 03:32:40 Caused by: java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms
2022-02-03T03:32:42.1045743Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
2022-02-03T03:32:42.1046739Z Feb 03 03:32:40 ... 28 more
2022-02-03T03:32:42.1048415Z Feb 03 03:32:40 2022-02-03 03:31:12,865 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping checkpoint coordinator for job 1470f23d8978792b87cf1e0a7989cf4b.
2022-02-03T03:32:42.1049876Z Feb 03 03:32:40 2022-02-03 03:31:13,384 INFO org.apache.flink.runtime.dispatcher.MiniDispatcher [] - Job 1470f23d8978792b87cf1e0a7989cf4b reached terminal state FAILED.
2022-02-03T03:32:42.1050779Z Feb 03 03:32:40 org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
2022-02-03T03:32:42.1051644Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
2022-02-03T03:32:42.1052703Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
2022-02-03T03:32:42.1053672Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252)
2022-02-03T03:32:42.1054545Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242)
2022-02-03T03:32:42.1055456Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233)
2022-02-03T03:32:42.1056359Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684)
2022-02-03T03:32:42.1057371Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51)
2022-02-03T03:32:42.1058972Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473)
2022-02-03T03:32:42.1059968Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133)
2022-02-03T03:32:42.1060759Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073)
2022-02-03T03:32:42.1061537Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912)
2022-02-03T03:32:42.1062343Z Feb 03 03:32:40 at org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474)
2022-02-03T03:32:42.1063258Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41)
2022-02-03T03:32:42.1064216Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609)
2022-02-03T03:32:42.1065421Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481)
2022-02-03T03:32:42.1066331Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)
2022-02-03T03:32:42.1067090Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)
2022-02-03T03:32:42.1067870Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2022-02-03T03:32:42.1068664Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
2022-02-03T03:32:42.1081893Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222)
2022-02-03T03:32:42.1084266Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164)
2022-02-03T03:32:42.1085364Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86)
2022-02-03T03:32:42.1556816Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66)
2022-02-03T03:32:42.1567351Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91)
2022-02-03T03:32:42.1576329Z Feb 03 03:32:40 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
2022-02-03T03:32:42.1582529Z Feb 03 03:32:40 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2022-02-03T03:32:42.1589395Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455)
2022-02-03T03:32:42.1596634Z Feb 03 03:32:40 at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
2022-02-03T03:32:42.1602522Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455)
2022-02-03T03:32:42.1607553Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213)
2022-02-03T03:32:42.1612919Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
2022-02-03T03:32:42.1617901Z Feb 03 03:32:40 at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
2022-02-03T03:32:42.1623062Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
2022-02-03T03:32:42.1627158Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
2022-02-03T03:32:42.1631148Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
2022-02-03T03:32:42.1635328Z Feb 03 03:32:40 at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
2022-02-03T03:32:42.1639444Z Feb 03 03:32:40 at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
2022-02-03T03:32:42.1643612Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
2022-02-03T03:32:42.1657446Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
2022-02-03T03:32:42.1658994Z Feb 03 03:32:40 at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
2022-02-03T03:32:42.1659681Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive(Actor.scala:537)
2022-02-03T03:32:42.1660291Z Feb 03 03:32:40 at akka.actor.Actor.aroundReceive$(Actor.scala:535)
2022-02-03T03:32:42.1660957Z Feb 03 03:32:40 at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
2022-02-03T03:32:42.1661614Z Feb 03 03:32:40 at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
2022-02-03T03:32:42.1662248Z Feb 03 03:32:40 at akka.actor.ActorCell.invoke(ActorCell.scala:548)
2022-02-03T03:32:42.1663139Z Feb 03 03:32:40 at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
2022-02-03T03:32:42.1663761Z Feb 03 03:32:40 at akka.dispatch.Mailbox.run(Mailbox.scala:231)
2022-02-03T03:32:42.1664352Z Feb 03 03:32:40 at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
2022-02-03T03:32:42.1664977Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
2022-02-03T03:32:42.1665699Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
2022-02-03T03:32:42.1666428Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
2022-02-03T03:32:42.1667159Z Feb 03 03:32:40 at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
2022-02-03T03:32:42.1668399Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1670724Z Feb 03 03:32:40 at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539)
2022-02-03T03:32:42.1671459Z Feb 03 03:32:40 ... 37 more
2022-02-03T03:32:42.1672305Z Feb 03 03:32:40 Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1673741Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
2022-02-03T03:32:42.1674562Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
2022-02-03T03:32:42.1675339Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607)
2022-02-03T03:32:42.1676113Z Feb 03 03:32:40 at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
2022-02-03T03:32:42.1676704Z Feb 03 03:32:40 ... 35 more
2022-02-03T03:32:42.1677453Z Feb 03 03:32:40 Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Slot request bulk is not fulfillable! Could not allocate the required slot within slot request timeout
2022-02-03T03:32:42.1678660Z Feb 03 03:32:40 at org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86)
2022-02-03T03:32:42.1679863Z Feb 03 03:32:40 ... 28 more
2022-02-03T03:32:42.1680414Z Feb 03 03:32:40 Caused by: java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms
2022-02-03T03:32:42.1680932Z Feb 03 03:32:40 ... 29 more
{code}
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=30660&view=logs&j=68a897ab-3047-5660-245a-cce8f83859f6&t=89ed5489-a970-5ff2-67f7-d7391de0165f&l=25597
--
This message was sent by Atlassian Jira
(v8.20.1#820001)