You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by william <71...@qq.com> on 2021/03/20 02:57:23 UTC

flink 使用yarn部署，报错：Maximum Memory: 8192 Requested: 10240MB. Please check the 'yarn.scheduler.maximum-allocation-mb' and the 'yarn.nodemanager.resource.memory-mb' configuration values

org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't
deploy Yarn session cluster
        at
org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:425)
        at
org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:606)
        at
org.apache.flink.yarn.cli.FlinkYarnSessionCli.lambda$main$4(FlinkYarnSessionCli.java:860)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
        at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at
org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:860)
Caused by:
org.apache.flink.yarn.YarnClusterDescriptor$YarnDeploymentException: The
cluster does not have the requested resources for the TaskManagers
available!
Maximum Memory: 8192 Requested: 10240MB. Please check the
'yarn.scheduler.maximum-allocation-mb' and the
'yarn.nodemanager.resource.memory-mb' configuration values




--
Sent from: http://apache-flink.147419.n8.nabble.com/

Re:flink 使用yarn部署，报错：Maximum Memory: 8192 Requested: 10240MB. Please check the 'yarn.scheduler.maximum-allocation-mb' and the 'yarn.nodemanager.resource.memory-mb' configuration values

Posted by Michael Ran <gr...@163.com>.
超过了 yarn 容器 配置吧
At 2021-03-20 10:57:23, "william" <71...@qq.com> wrote:
>org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't
>deploy Yarn session cluster
>        at
>org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:425)
>        at
>org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:606)
>        at
>org.apache.flink.yarn.cli.FlinkYarnSessionCli.lambda$main$4(FlinkYarnSessionCli.java:860)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:422)
>        at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
>        at
>org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
>        at
>org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:860)
>Caused by:
>org.apache.flink.yarn.YarnClusterDescriptor$YarnDeploymentException: The
>cluster does not have the requested resources for the TaskManagers
>available!
>Maximum Memory: 8192 Requested: 10240MB. Please check the
>'yarn.scheduler.maximum-allocation-mb' and the
>'yarn.nodemanager.resource.memory-mb' configuration values
>
>
>
>
>--
>Sent from: http://apache-flink.147419.n8.nabble.com/

Re: flink 使用yarn部署，报错：Maximum Memory: 8192 Requested: 10240MB. Please check the 'yarn.scheduler.maximum-allocation-mb' and the 'yarn.nodemanager.resource.memory-mb' configuration values

Posted by Xintong Song <to...@gmail.com>.
报错信息里已经说明了：你的 Yarn 集群配置允许的最大 container 是 2g，而你的 flink 配置的 TM 大小是 10g。

Thank you~

Xintong Song



On Sat, Mar 20, 2021 at 7:52 PM william <71...@qq.com> wrote:

> org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't
> deploy Yarn session cluster
>         at
>
> org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:425)
>         at
>
> org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:606)
>         at
>
> org.apache.flink.yarn.cli.FlinkYarnSessionCli.lambda$main$4(FlinkYarnSessionCli.java:860)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
>         at
>
> org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
>         at
>
> org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:860)
> Caused by:
> org.apache.flink.yarn.YarnClusterDescriptor$YarnDeploymentException: The
> cluster does not have the requested resources for the TaskManagers
> available!
> Maximum Memory: 8192 Requested: 10240MB. Please check the
> 'yarn.scheduler.maximum-allocation-mb' and the
> 'yarn.nodemanager.resource.memory-mb' configuration values
>
>
>
>
> --
> Sent from: http://apache-flink.147419.n8.nabble.com/
>