You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Wangda Tan (Jira)" <ji...@apache.org> on 2020/12/11 20:20:00 UTC

[jira] [Created] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

Wangda Tan created YARN-10531:
---------------------------------

             Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue
                 Key: YARN-10531
                 URL: https://issues.apache.org/jira/browse/YARN-10531
             Project: Hadoop YARN
          Issue Type: Sub-task
            Reporter: Wangda Tan


User limit factor is used to define max cap of how much resource can be consumed by single user. 

Under Auto Queue Creation context, it doesn't make much sense to set user limit factor, because initially every queue will set weight to 1.0, we want user can consume more resource if possible. It is hard to pre-determine how to set up user limit factor. So it makes more sense to add a new value (like -1) to indicate we will disable user limit factor 

Logic need to be changed is below: 

(Inside LeafQueue.java)

{code}
    Resource maxUserLimit = Resources.none();
    if (schedulingMode == SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY) {
      maxUserLimit = Resources.multiplyAndRoundDown(queueCapacity,
          getUserLimitFactor());
    } else if (schedulingMode == SchedulingMode.IGNORE_PARTITION_EXCLUSIVITY) {
      maxUserLimit = partitionResource;
    }
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org