[jira] [Assigned] (YARN-8061) An application may preempt itself in case of minshare preemption

["Zhaohui Xin (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/YARN-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhaohui Xin reassigned YARN-8061:
---------------------------------

    Assignee: Zhaohui Xin

> An application may preempt itself in case of minshare preemption
> ----------------------------------------------------------------
>
>                 Key: YARN-8061
>                 URL: https://issues.apache.org/jira/browse/YARN-8061
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.9.0, 2.8.3, 3.0.0
>            Reporter: Yufei Gu
>            Assignee: Zhaohui Xin
>            Priority: Major
>
> Assume a leaf queue A's minshare is 10G memory and fairshare is 12G. It used 4G, so its minshare-staved resources is 6G and will be distributed to all its apps. Assume there are 4 apps a1, a2, a3, a4 inside, who demand 3G, 2G, 1G, and 0.5G. a1 gets 3G minshare-starved resources, a2 gets 2G, a3 get 1G, they are all considered as starved apps except a4 who doesn't get any. 
> An app can preempt another under the same queue due to minshare starvation. For example, a1 can preempt a4 if a4 uses more resources than its fair share, which is 3G(12G/4). If a1 itself used more than 3G memory, it will preempt itself! I will create a unit test later. 
> The solution would check application's fair share while distributing minshare starvation, more details in method {{FSLeafQueue#updateStarvedAppsMinshare()}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org