You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dawid Wysakowicz (Jira)" <ji...@apache.org> on 2021/01/25 08:00:19 UTC

[jira] [Created] (FLINK-21118) TPC-DS end-to-end test (Blink planner) fails with "no more allocated slots"

Dawid Wysakowicz created FLINK-21118:
----------------------------------------

             Summary: TPC-DS end-to-end test (Blink planner) fails with "no more allocated slots"
                 Key: FLINK-21118
                 URL: https://issues.apache.org/jira/browse/FLINK-21118
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / Planner, Tests
    Affects Versions: 1.12.2
            Reporter: Dawid Wysakowicz


https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=12416&view=logs&j=68a897ab-3047-5660-245a-cce8f83859f6&t=16ca2cca-2f63-5cce-12d2-d519b930a729

{code}
2021-01-24T01:02:01.5533423Z Jan 24 01:02:01 Job has been submitted with JobID a319d24b44e85ab9e4f71a9d8ff492ee
2021-01-24T01:02:01.6629344Z 
2021-01-24T01:02:01.6633209Z ------------------------------------------------------------
2021-01-24T01:02:01.6635643Z  The program finished with the following exception:
2021-01-24T01:02:01.6637236Z 
2021-01-24T01:02:01.6642777Z org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: a319d24b44e85ab9e4f71a9d8ff492ee)
2021-01-24T01:02:01.6645759Z 	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:360)
2021-01-24T01:02:01.6648332Z 	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:213)
2021-01-24T01:02:01.6650691Z 	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
2021-01-24T01:02:01.6674712Z 	at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:816)
2021-01-24T01:02:01.6675237Z 	at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:248)
2021-01-24T01:02:01.6675707Z 	at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1058)
2021-01-24T01:02:01.6676211Z 	at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1136)
2021-01-24T01:02:01.6704980Z 	at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28)
2021-01-24T01:02:01.6706649Z 	at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1136)
2021-01-24T01:02:01.6707315Z Caused by: java.util.concurrent.ExecutionException: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: a319d24b44e85ab9e4f71a9d8ff492ee)
2021-01-24T01:02:01.6714027Z 	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2021-01-24T01:02:01.6715433Z 	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2021-01-24T01:02:01.6716254Z 	at org.apache.flink.table.tpcds.TpcdsTestProgram.main(TpcdsTestProgram.java:124)
2021-01-24T01:02:01.6716712Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-01-24T01:02:01.6717148Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-01-24T01:02:01.6717681Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-01-24T01:02:01.6719261Z 	at java.lang.reflect.Method.invoke(Method.java:498)
2021-01-24T01:02:01.6719747Z 	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:343)
2021-01-24T01:02:01.6720118Z 	... 8 more
2021-01-24T01:02:01.6720560Z Caused by: org.apache.flink.client.program.ProgramInvocationException: Job failed (JobID: a319d24b44e85ab9e4f71a9d8ff492ee)
2021-01-24T01:02:01.6721239Z 	at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:125)
2021-01-24T01:02:01.6721827Z 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
2021-01-24T01:02:01.6722351Z 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
2021-01-24T01:02:01.6722881Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2021-01-24T01:02:01.6723380Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2021-01-24T01:02:01.6723963Z 	at org.apache.flink.client.program.rest.RestClusterClient.lambda$pollResourceAsync$22(RestClusterClient.java:665)
2021-01-24T01:02:01.6724556Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2021-01-24T01:02:01.6725090Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2021-01-24T01:02:01.6725634Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2021-01-24T01:02:01.6726148Z 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
2021-01-24T01:02:01.6726692Z 	at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$9(FutureUtils.java:394)
2021-01-24T01:02:01.6727264Z 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2021-01-24T01:02:01.6727812Z 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2021-01-24T01:02:01.6728338Z 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2021-01-24T01:02:01.6728850Z 	at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
2021-01-24T01:02:01.6729375Z 	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
2021-01-24T01:02:01.6729894Z 	at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
2021-01-24T01:02:01.6730412Z 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2021-01-24T01:02:01.6730929Z 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2021-01-24T01:02:01.6731344Z 	at java.lang.Thread.run(Thread.java:748)
2021-01-24T01:02:01.6731774Z Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
2021-01-24T01:02:01.6732304Z 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
2021-01-24T01:02:01.6732900Z 	at org.apache.flink.client.deployment.ClusterClientJobClientAdapter.lambda$null$6(ClusterClientJobClientAdapter.java:123)
2021-01-24T01:02:01.6733351Z 	... 19 more
2021-01-24T01:02:01.6733738Z Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
2021-01-24T01:02:01.6734365Z 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:118)
2021-01-24T01:02:01.6735111Z 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:80)
2021-01-24T01:02:01.6735855Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:233)
2021-01-24T01:02:01.6736440Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:224)
2021-01-24T01:02:01.6737075Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:215)
2021-01-24T01:02:01.6737746Z 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:665)
2021-01-24T01:02:01.6738429Z 	at org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:56)
2021-01-24T01:02:01.6739194Z 	at org.apache.flink.runtime.executiongraph.ExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(ExecutionGraph.java:1869)
2021-01-24T01:02:01.6739805Z 	at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1450)
2021-01-24T01:02:01.6740341Z 	at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1390)
2021-01-24T01:02:01.6740837Z 	at org.apache.flink.runtime.executiongraph.Execution.fail(Execution.java:1057)
2021-01-24T01:02:01.6741412Z 	at org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.signalPayloadRelease(SingleLogicalSlot.java:213)
2021-01-24T01:02:01.6742031Z 	at org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.release(SingleLogicalSlot.java:200)
2021-01-24T01:02:01.6742584Z 	at org.apache.flink.runtime.scheduler.SharedSlot.lambda$release$4(SharedSlot.java:272)
2021-01-24T01:02:01.6743170Z 	at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670)
2021-01-24T01:02:01.6743691Z 	at java.util.concurrent.CompletableFuture.uniAcceptStage(CompletableFuture.java:683)
2021-01-24T01:02:01.6744197Z 	at java.util.concurrent.CompletableFuture.thenAccept(CompletableFuture.java:2010)
2021-01-24T01:02:01.6744704Z 	at org.apache.flink.runtime.scheduler.SharedSlot.release(SharedSlot.java:272)
2021-01-24T01:02:01.6745250Z 	at org.apache.flink.runtime.jobmaster.slotpool.AllocatedSlot.releasePayload(AllocatedSlot.java:152)
2021-01-24T01:02:01.6745846Z 	at org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManagerInternal(SlotPoolImpl.java:941)
2021-01-24T01:02:01.6746461Z 	at org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManager(SlotPoolImpl.java:892)
2021-01-24T01:02:01.6747037Z 	at org.apache.flink.runtime.jobmaster.JobMaster.disconnectTaskManager(JobMaster.java:502)
2021-01-24T01:02:01.6747483Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-01-24T01:02:01.6747933Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-01-24T01:02:01.6748594Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-01-24T01:02:01.6749051Z 	at java.lang.reflect.Method.invoke(Method.java:498)
2021-01-24T01:02:01.6749533Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:306)
2021-01-24T01:02:01.6750099Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213)
2021-01-24T01:02:01.6750661Z 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77)
2021-01-24T01:02:01.6751233Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:159)
2021-01-24T01:02:01.6751729Z 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
2021-01-24T01:02:01.6752158Z 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
2021-01-24T01:02:01.6752611Z 	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
2021-01-24T01:02:01.6753076Z 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
2021-01-24T01:02:01.6753530Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
2021-01-24T01:02:01.6753994Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
2021-01-24T01:02:01.6754552Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
2021-01-24T01:02:01.6754971Z 	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
2021-01-24T01:02:01.6755408Z 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
2021-01-24T01:02:01.6755848Z 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
2021-01-24T01:02:01.6756245Z 	at akka.actor.ActorCell.invoke(ActorCell.scala:561)
2021-01-24T01:02:01.6756717Z 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
2021-01-24T01:02:01.6757095Z 	at akka.dispatch.Mailbox.run(Mailbox.scala:225)
2021-01-24T01:02:01.6757469Z 	at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
2021-01-24T01:02:01.6757883Z 	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
2021-01-24T01:02:01.6758351Z 	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
2021-01-24T01:02:01.6758844Z 	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
2021-01-24T01:02:01.6759344Z 	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2021-01-24T01:02:01.6760099Z Caused by: org.apache.flink.util.FlinkException: TaskExecutor akka.tcp://flink@10.1.0.4:36261/user/rpc/taskmanager_0 has no more allocated slots for job a319d24b44e85ab9e4f71a9d8ff492ee.
2021-01-24T01:02:01.6760962Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$closeJobManagerConnectionIfNoAllocatedResources$23(TaskExecutor.java:1839)
2021-01-24T01:02:01.6761511Z 	at java.util.Optional.ifPresent(Optional.java:159)
2021-01-24T01:02:01.6762017Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.closeJobManagerConnectionIfNoAllocatedResources(TaskExecutor.java:1833)
2021-01-24T01:02:01.6762625Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.freeSlotInternal(TaskExecutor.java:1815)
2021-01-24T01:02:01.6763162Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.timeoutSlot(TaskExecutor.java:1851)
2021-01-24T01:02:01.6763696Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.access$2800(TaskExecutor.java:174)
2021-01-24T01:02:01.6764300Z 	at org.apache.flink.runtime.taskexecutor.TaskExecutor$SlotActionsImpl.lambda$timeoutSlot$1(TaskExecutor.java:2191)
2021-01-24T01:02:01.6764901Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:442)
2021-01-24T01:02:01.6765442Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:209)
2021-01-24T01:02:01.6765810Z 	... 19 more
2021-01-24T01:02:01.6993369Z Jan 24 01:02:01 [FAIL] Test script contains errors.
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)