You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/02/23 08:38:44 UTC
[jira] [Commented] (FLINK-5856) Need return redundant containers to
yarn for yarn mode
[ https://issues.apache.org/jira/browse/FLINK-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880121#comment-15880121 ]
ASF GitHub Bot commented on FLINK-5856:
---------------------------------------
GitHub user shuai-xu opened a pull request:
https://github.com/apache/flink/pull/3398
[FLINK-5856] return redundant containers to yarn for yarn mode
This pr is for jira-#[5856](https://issues.apache.org/jira/browse/FLINK-5856)
The yarn AMRMClient used for requesting containers from yarn in flink has its own defects:
It need to remove container requests after container returned, or else the requests will be sent again.
Even so, it doesn't guarantee that the number of containers return is exactly equal to the number requested.
So need to release the redundant containers returned for yarn mode as we ask for containers according to the need of a job.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shuai-xu/flink jira-5856
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3398.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3398
----
commit 28d0c1b843520ffda3124cdb96dfd7826ae64db5
Author: shuai.xus <sh...@alibaba-inc.com>
Date: 2017-02-23T08:12:24Z
[FLINK-5856] return redundant containers to yarn for yarn mode
----
> Need return redundant containers to yarn for yarn mode
> ------------------------------------------------------
>
> Key: FLINK-5856
> URL: https://issues.apache.org/jira/browse/FLINK-5856
> Project: Flink
> Issue Type: Bug
> Components: YARN
> Reporter: shuai.xu
> Assignee: shuai.xu
> Labels: flip-6
>
> For flink on yarn mode, RM requests container from yarn according to the requirement of the JM. But the AMRMClientAsync used in yarn doesn't guarantee that the number of containers returned exactly equal to the number requested. So it need to record the number request by flink rm and return the redundant ones to yarn.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)