[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

["Wangda Tan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15236305#comment-15236305 ] 

Wangda Tan commented on YARN-4945:
----------------------------------

Some rough ideas about design:
In general, after YARN-4822, we can implement and active new intra-queue preemption candidate selector according to queue's policy.

There're a couple of things that needs to think more:
- Compute ideal resource allocation of applications: Currently we only support calculating queue's ideal resource allocation. We should calculate apps' ideal allocation as well.
- Configuration of intra-queue preemption: we should be able to turn on/off intra/inter queue preemption separately.
- When intra-queue preemption can happen: in some cases, we need intra-queue preemption happen when queue is under its guaranteed resource, and we also need to make sure no excessive preemption (like crossfire between apps) happens.
- Priorities of intra-queue preemption and inter-queue preemption. Intra-queue preemption should happen after inter-queue preemption, IAW, in an under-satisfied queue, an app should prefer to get resources from an over-satisfied queue instead of from other apps in the same queue.

+ [~sunilg], [~eepayne].

> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>
>                 Key: YARN-4945
>                 URL: https://issues.apache.org/jira/browse/YARN-4945
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Wangda Tan
>
> This is umbrella ticket to track efforts of preemption within a queue to support features like:
> YARN-2009. YARN-2113. YARN-4781.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)