[jira] [Created] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

["Sandy Ryza (JIRA)" <ji...@apache.org>]

Sandy Ryza created YARN-596:
-------------------------------

             Summary: In fair scheduler, intra-application container priorities affect inter-application preemption decisions
                 Key: YARN-596
                 URL: https://issues.apache.org/jira/browse/YARN-596
             Project: Hadoop YARN
          Issue Type: Bug
          Components: scheduler
    Affects Versions: 2.0.3-alpha
            Reporter: Sandy Ryza
            Assignee: Sandy Ryza


In the fair scheduler, containers are chosen for preemption in the following way:
All containers for all apps that are in queues that are over their fair share are put in a list.
The list is sorted in order of the priority that the container was requested in.

This means that an application can shield itself from preemption by requesting it's containers at higher priorities, which doesn't really make sense.

Also, an application that is not over its fair share, but that is in a queue that is over it's fair share is just as likely to have containers preempted as an application that is over its fair share.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira