You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2018/12/03 10:10:00 UTC
[jira] [Commented] (FLINK-10868) Flink's JobCluster ResourceManager
doesn't use yarn.maximum-failed-containers as limit of resource acquirement
[ https://issues.apache.org/jira/browse/FLINK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16706928#comment-16706928 ]
Till Rohrmann commented on FLINK-10868:
---------------------------------------
FLINK-10848 is definitely a problem which we should fix.
For the other part I'm a bit hesitant to introduce a new communication channel between the {{Dispatcher}} and the {{ResourceManager}} tbh. Instead a different way could be to let the {{RestartStrategy}} handle the situation. For example, if the {{ResourceManager}} notices that it cannot start new {{TaskExecutors}}, it could fail all pending allocation requests with a special exception. This exception will be sent to all {{JobMasters}} which have pending requests. They can then decide on their own whether they want to restart or fail the job permanently.
What do you think?
> Flink's JobCluster ResourceManager doesn't use yarn.maximum-failed-containers as limit of resource acquirement
> --------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-10868
> URL: https://issues.apache.org/jira/browse/FLINK-10868
> Project: Flink
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.2, 1.7.0
> Reporter: Zhenqiu Huang
> Assignee: Zhenqiu Huang
> Priority: Major
>
> Currently, YarnResourceManager does use yarn.maximum-failed-containers as limit of resource acquirement. In worse case, when new start containers consistently fail, YarnResourceManager will goes into an infinite resource acquirement process without failing the job. Together with the https://issues.apache.org/jira/browse/FLINK-10848, It will quick occupy all resources of yarn queue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)