You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Sudhir Babu Pothineni (JIRA)" <ji...@apache.org> on 2019/04/29 20:55:00 UTC
[jira] [Comment Edited] (YARN-9520) fair scheduler:
inter-queue-preemption.enabled, intra-queue-preemption.enabled options
[ https://issues.apache.org/jira/browse/YARN-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829704#comment-16829704 ]
Sudhir Babu Pothineni edited comment on YARN-9520 at 4/29/19 8:54 PM:
----------------------------------------------------------------------
Lets say 100 applications in the queue A, 10 applications are running occupied 100% of the cluster, In my case they should keep running even after Fairshare timeout, only after as soon as the containers finished from running jobs, remaining jobs should be allocated. But I think these running jobs are preempted by waiting jobs after Fair share timeout, Preemption enabled because Queue B or C can be active any time. If I put maximum applications per queue 10, cluster is under utilized.
Capacity scheduler has inter-queue-preemption.enabled, intra-queue-preemption.enabled, is there any specific reason they are not there in fair scheduler?
was (Author: sbpothineni):
Lets say 100 applications in the queue A, 10 applications are running occupied 100% of the cluster, In my case they should keep running even after Fairshare timeout, only after as soon as the containers finished from running jobs, remaining jobs should be allocated. But I think these running jobs are preempted by waiting jobs after Fair share timeout, Preemption enabled because Queue B or C can be active any time. If I put maximum applications per queue 10, cluster is under utilized.
Capacity scheduler has inter-queue-preemption.enabled, intra-queue-preemption.enabled, is there any specifica reason they are not there in fair scheduler?
> fair scheduler: inter-queue-preemption.enabled, intra-queue-preemption.enabled options
> --------------------------------------------------------------------------------------
>
> Key: YARN-9520
> URL: https://issues.apache.org/jira/browse/YARN-9520
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: fairscheduler
> Reporter: Sudhir Babu Pothineni
> Priority: Major
>
> Its good to have inter-queue-preemption-enabled, intra-queue-preemption-enabled options for fair scheduler, i have a use case where we need inter-queue-preemption-enabled=false
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org