You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "bc Wong (JIRA)" <ji...@apache.org> on 2014/09/02 10:44:21 UTC

[jira] [Updated] (YARN-596) Use scheduling policies throughout the queue hierarchy to decide which containers to preempt

     [ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

bc Wong updated YARN-596:
-------------------------
    Description: 
  In the fair scheduler, containers are chosen for preemption in the following way:
All containers for all apps that are in queues that are over their fair share are put in a list.
The list is sorted in order of the priority that the container was requested in.

This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.

Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.

  was:
In the fair scheduler, containers are chosen for preemption in the following way:
All containers for all apps that are in queues that are over their fair share are put in a list.
The list is sorted in order of the priority that the container was requested in.

This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.

Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.


> Use scheduling policies throughout the queue hierarchy to decide which containers to preempt
> --------------------------------------------------------------------------------------------
>
>                 Key: YARN-596
>                 URL: https://issues.apache.org/jira/browse/YARN-596
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 2.0.3-alpha
>            Reporter: Sandy Ryza
>            Assignee: Wei Yan
>             Fix For: 2.5.0
>
>         Attachments: YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch, YARN-596.patch
>
>
>   In the fair scheduler, containers are chosen for preemption in the following way:
> All containers for all apps that are in queues that are over their fair share are put in a list.
> The list is sorted in order of the priority that the container was requested in.
> This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.
> Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)