You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Benjamin Teke (Jira)" <ji...@apache.org> on 2022/03/28 18:11:00 UTC

[jira] [Comment Edited] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

    [ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513547#comment-17513547 ] 

Benjamin Teke edited comment on YARN-10559 at 3/28/22, 6:10 PM:
----------------------------------------------------------------

[~ananyo_rao] since this is pending for a while now and the patch doesn't apply to trunk anymore, do you plan to update it? If not, would you mind if I take over the task of managing/updating it?


was (Author: bteke):
[~ananyo_rao] since this is pending for a while now and the patch doesn't apply to trunk anymore, do you plan to update it? If not, would you mind if I take over managing/updating it?

> Fair sharing intra-queue preemption support in Capacity Scheduler
> -----------------------------------------------------------------
>
>                 Key: YARN-10559
>                 URL: https://issues.apache.org/jira/browse/YARN-10559
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler
>    Affects Versions: 3.1.4
>            Reporter: VADAGA ANANYO RAO
>            Assignee: VADAGA ANANYO RAO
>            Priority: Major
>         Attachments: FairOP_preemption-design_doc_v1.pdf, FairOP_preemption-design_doc_v2.pdf, YARN-10559.0001.patch, YARN-10559.0002.patch, YARN-10559.0003.patch, YARN-10559.0004.patch, YARN-10559.0005.patch, YARN-10559.0006.patch, YARN-10559.0007.patch, YARN-10559.0008.patch, YARN-10559.0009.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Usecase:
> Due to the way Capacity Scheduler preemption works, If a single user submits a large application to a queue (using 100% of resources), that job will not be preempted by future applications from the same user within the same queue. This implies that the later applications will be forced to wait for completion of the long running application. This prevents multiple long running, large, applications from running concurrently.
> Support fair sharing among apps while preempting applications from same queue.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org