You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2019/01/17 13:43:00 UTC
[jira] [Commented] (FLINK-11377) AbstractYarnClusterDescriptor's
validClusterSpecification is not final application resources from yarn if
cli -yn -ys not effect
[ https://issues.apache.org/jira/browse/FLINK-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745058#comment-16745058 ]
Till Rohrmann commented on FLINK-11377:
---------------------------------------
Hi [~shengjk1], {{-yn}} will no longer be respected by Flink's new mode. Only the legacy mode respected this option. The reason is that Flink now dynamically allocates as many containers as it requires to execute the job. Does this make sense? If yes, then please close this issue.
> AbstractYarnClusterDescriptor's validClusterSpecification is not final application resources from yarn if cli -yn -ys not effect
> ------------------------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-11377
> URL: https://issues.apache.org/jira/browse/FLINK-11377
> Project: Flink
> Issue Type: Bug
> Affects Versions: 1.7.1
> Environment: java: jdk1.8.0_151
> flink: flink-1.7.1
> CDH:CDH-5.13.1-1.cdh5.13.1.p0.2
> Reporter: shengjk1
> Priority: Major
> Attachments: image-2019-01-17-14-57-24-060.png
>
>
> when cli -yn -ys not effect ,AbstractYarnClusterDescriptor's validClusterSpecification is not final application resources from yarn (cli -yn -ys not effect can refer to https://issues.apache.org/jira/browse/FLINK-11376)
>
> the cli :
> flink-1.7.1/bin/flink run -m yarn-cluster -yn 1 -ys 1 -ynm test -ccom.ishansong.bigdata.Main222 ./flinkDemo-1.0-SNAPSHOT.jar
> AbstractYarnClusterDescriptor's log :
> org.apache.flink.yarn.AbstractYarnClusterDescriptor - Cluster specification: ClusterSpecification\{masterMemoryMB=1024, taskManagerMemoryMB=1024, numberTaskManagers=1, slotsPerTaskManager=1}
> but yarn web ui:
> allocated containers=4 and allocated cpu cores=4
> !image-2019-01-17-14-57-24-060.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)