You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Wangda Tan (Jira)" <ji...@apache.org> on 2020/12/11 20:20:00 UTC
[jira] [Created] (YARN-10531) Be able to disable user limit factor
for CapacityScheduler Leaf Queue
Wangda Tan created YARN-10531:
---------------------------------
Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue
Key: YARN-10531
URL: https://issues.apache.org/jira/browse/YARN-10531
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Wangda Tan
User limit factor is used to define max cap of how much resource can be consumed by single user.
Under Auto Queue Creation context, it doesn't make much sense to set user limit factor, because initially every queue will set weight to 1.0, we want user can consume more resource if possible. It is hard to pre-determine how to set up user limit factor. So it makes more sense to add a new value (like -1) to indicate we will disable user limit factor
Logic need to be changed is below:
(Inside LeafQueue.java)
{code}
Resource maxUserLimit = Resources.none();
if (schedulingMode == SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY) {
maxUserLimit = Resources.multiplyAndRoundDown(queueCapacity,
getUserLimitFactor());
} else if (schedulingMode == SchedulingMode.IGNORE_PARTITION_EXCLUSIVITY) {
maxUserLimit = partitionResource;
}
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org