[jira] [Created] (YARN-8061) An application may preempt itself in case of minshare preemption

["Yufei Gu (JIRA)" <ji...@apache.org>]

Yufei Gu created YARN-8061:
------------------------------

             Summary: An application may preempt itself in case of minshare preemption
                 Key: YARN-8061
                 URL: https://issues.apache.org/jira/browse/YARN-8061
             Project: Hadoop YARN
          Issue Type: Bug
          Components: fairscheduler
    Affects Versions: 3.0.0, 2.8.3, 2.9.0
            Reporter: Yufei Gu
            Assignee: Yufei Gu


Assume a leaf queue A's minshare is 10G memory and fairshare is 12G. It used 4G, so its minshare-staved resources is 6G and will be distributed to all its apps. Assume there are 4 apps a1, a2, a3, a4 inside, who demand 3G, 2G, 1G, and 0.5G. a1 gets 3G minshare-starved resources, a2 gets 2G, a3 get 1G, they are all considered as starved apps except a4 who doesn't get any. 

An app can preempt another under the same queue due to minshare starvation. For example, a1 can preempt a4 if a4 uses more resources than its fair share, which is 3G(12G/4). If a1 itself used more than 3G memory, it will preempt itself! I will create a unit test later. 

The solution would check application's fair share while distributing minshare starvation, more details in method {{FSLeafQueue#updateStarvedAppsMinshare()}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org