You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Sunil G (JIRA)" <ji...@apache.org> on 2017/03/09 17:28:38 UTC
[jira] [Updated] (YARN-2113) Add cross-user preemption within
CapacityScheduler's leaf-queue
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sunil G updated YARN-2113:
--------------------------
Attachment: YARN-2113.v0.patch
Attaching v0 patch for user-limit preemption.
This patch is done on top of YARN-2009 where we have already done intra-queue preemption framework. This patch focus on adding support to do user-limit preemption if any is used is under-served, and some other users are abusing the limit.
Basic test cases are added from preemption module. However I will be adding some more test cases from scheduler side to ensure that UL computation is also correct.
[~leftnoteasy] and [~eepayne], please help to share some early feedback.
> Add cross-user preemption within CapacityScheduler's leaf-queue
> ---------------------------------------------------------------
>
> Key: YARN-2113
> URL: https://issues.apache.org/jira/browse/YARN-2113
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: scheduler
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Vinod Kumar Vavilapalli
> Attachments: YARN-2113.v0.patch
>
>
> Preemption today only works across queues and moves around resources across queues per demand and usage. We should also have user-level preemption within a queue, to balance capacity across users in a predictable manner.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org