You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Wangda Tan (Jira)" <ji...@apache.org> on 2020/12/11 20:21:00 UTC

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

    [ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248149#comment-17248149 ] 

Wangda Tan commented on YARN-10531:
-----------------------------------

[~zhuqi] do you want to take a try on this one? 

Thanks, 

> Be able to disable user limit factor for CapacityScheduler Leaf Queue
> ---------------------------------------------------------------------
>
>                 Key: YARN-10531
>                 URL: https://issues.apache.org/jira/browse/YARN-10531
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Wangda Tan
>            Priority: Major
>
> User limit factor is used to define max cap of how much resource can be consumed by single user. 
> Under Auto Queue Creation context, it doesn't make much sense to set user limit factor, because initially every queue will set weight to 1.0, we want user can consume more resource if possible. It is hard to pre-determine how to set up user limit factor. So it makes more sense to add a new value (like -1) to indicate we will disable user limit factor 
> Logic need to be changed is below: 
> (Inside LeafQueue.java)
> {code}
>     Resource maxUserLimit = Resources.none();
>     if (schedulingMode == SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY) {
>       maxUserLimit = Resources.multiplyAndRoundDown(queueCapacity,
>           getUserLimitFactor());
>     } else if (schedulingMode == SchedulingMode.IGNORE_PARTITION_EXCLUSIVITY) {
>       maxUserLimit = partitionResource;
>     }
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org