[jira] [Commented] (FLINK-8711) Flink with YARN uses wrong SlotsPerTaskManager

["Aljoscha Krettek (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369829#comment-16369829 ] 

Aljoscha Krettek commented on FLINK-8711:
-----------------------------------------

I think the original reasoning behind this is that it would lead to unused resources if Flink allowed specifying a number of slots where {{num task managers * num slots}} is different from {{parallelism}}.

[~till.rohrmann] What's the behaviour of the new FLIP-6 code regarding this?

> Flink with YARN uses wrong SlotsPerTaskManager
> ----------------------------------------------
>
>                 Key: FLINK-8711
>                 URL: https://issues.apache.org/jira/browse/FLINK-8711
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.3.2
>            Reporter: Aleksandr
>            Priority: Major
>
> I see wrong behavior for Flink in YARN.
> I tried to setup SlotsPerTaskManager using "-ys 2 ", but it used only 1 slot.
> I found the code [https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/cli/FlinkYarnSessionCli.java#L387]
> For example, when I have :"-yn 7 -ys 2  -p 2" in log I see:
>  "The YARN cluster has 14 slots available, but the user requested a parallelism of 2 on YARN. Each of the 7 TaskManagers will get 1 slots."
> Why can't we use -ys with -p?
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)