You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by 史 正超 <sh...@outlook.com> on 2020/11/16 05:30:00 UTC

flink-1.11.2 job启动不起来，

启动命令：run -d -m yarn-cluster -p 12 -yjm 1600 -ytm 12288 -ys 12 -ynm xxx -yqu flink-critical -j /app/flink-1.11.2/executor/fcbox-streaming-sql-platform-1.11.jar --sqlid 17 --jobName realtime_app_kpi_dis_day_16

12个并行度， 12个slot，启动不了

Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: No pooled slot available and request to ResourceManager for new slot failed
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
        at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:593)
        at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
        ... 29 common frames omitted
Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: No pooled slot available and request to ResourceManager for new slot failed
        ... 27 common frames omitted
Caused by: org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Could not fulfill slot request d0d4eb5366379663f826d9cbf1eb3ff0.
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.registerSlotRequest(SlotManagerImpl.java:391)
        at org.apache.flink.runtime.resourcemanager.ResourceManager.requestSlot(ResourceManager.java:457)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:284)
        at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:199)
        ... 20 common frames omitted
Caused by: org.apache.flink.runtime.resourcemanager.exceptions.UnfulfillableSlotRequestException: Could not fulfill slot request d0d4eb5366379663f826d9cbf1eb3ff0. Requested resource profile (ResourceProfile{UNKNOWN}) is unfulfillable.
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$fulfillPendingSlotRequestWithPendingTaskManagerSlot$11(SlotManagerImpl.java:882)
        at org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.fulfillPendingSlotRequestWithPendingTaskManagerSlot(SlotManagerImpl.java:878)
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.lambda$internalRequestSlot$9(SlotManagerImpl.java:865)
        at org.apache.flink.util.OptionalConsumer.ifNotPresent(OptionalConsumer.java:52)
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.internalRequestSlot(SlotManagerImpl.java:865)
        at org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl.registerSlotRequest(SlotManagerImpl.java:386)
        ... 27 common frames omitted

Re: flink-1.11.2 job启动不起来，

Posted by zhisheng <zh...@gmail.com>.
hi，正超

建议把作业的日志发一下？

Best
zhisheng

神奇哥哥 <75...@qq.com> 于2020年12月1日周二 上午9:38写道：

> 你好，此问题我也遇到。目前已解决。
> 解决办法:
> 查看你pom文件中是否引入了hadoop相关依赖，Flink 1.11需要把hadoop相关依赖注释掉。
>
>
>
> --
> Sent from: http://apache-flink.147419.n8.nabble.com/

Re: flink-1.11.2 job启动不起来，

Posted by 神奇哥哥 <75...@qq.com>.
你好，此问题我也遇到。目前已解决。
解决办法:
查看你pom文件中是否引入了hadoop相关依赖，Flink 1.11需要把hadoop相关依赖注释掉。



--
Sent from: http://apache-flink.147419.n8.nabble.com/

Re: flink-1.11.2 job启动不起来，

Posted by 神奇哥哥 <75...@qq.com>.
注意是不是hadoop-client包冲突，hbase-server中也依赖了此包，需要排除。 



--
Sent from: http://apache-flink.147419.n8.nabble.com/