You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aleksandr (JIRA)" <ji...@apache.org> on 2018/02/20 07:40:00 UTC
[jira] [Updated] (FLINK-8711) Flink with YARN use wrong
SlotsPerTaskManager
[ https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aleksandr updated FLINK-8711:
-----------------------------
Description:
I see wrong behavior for Flink in YARN.
I tried to setup SlotsPerTaskManager using "-ys 2 ", but it used only 1 slot.
I found the code [https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/cli/FlinkYarnSessionCli.java#L387]
For example, when I have :"-yn 7 -ys 2 -p 2" in log I see:
"The YARN cluster has 14 slots available, but the user requested a parallelism of 2 on YARN. Each of the 7 TaskManagers will get 1 slots."
Why can't we use -ys with -p?
was:
I see wrong behavior for Flink in YARN.
I tried to setup SlotsPerTaskManager using "-ys 2 ", but it used only 1 slot.
I found the code [https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/cli/FlinkYarnSessionCli.java#L387]
For example, when I have :"-yn 7 -ys 2 -p 2" in log I see:
@james.tan @yinhua I see strange behavior:"-yn 7 -ys 2 -p 2" in log I see
"The YARN cluster has 14 slots available, but the user requested a parallelism of 2 on YARN. Each of the 7 TaskManagers will get 1 slots."
Why can't we use -ys with -p?
> Flink with YARN use wrong SlotsPerTaskManager
> ---------------------------------------------
>
> Key: FLINK-8711
> URL: https://issues.apache.org/jira/browse/FLINK-8711
> Project: Flink
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.3.2
> Reporter: Aleksandr
> Priority: Major
>
> I see wrong behavior for Flink in YARN.
> I tried to setup SlotsPerTaskManager using "-ys 2 ", but it used only 1 slot.
> I found the code [https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/cli/FlinkYarnSessionCli.java#L387]
> For example, when I have :"-yn 7 -ys 2 -p 2" in log I see:
> "The YARN cluster has 14 slots available, but the user requested a parallelism of 2 on YARN. Each of the 7 TaskManagers will get 1 slots."
> Why can't we use -ys with -p?
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)