You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "zhuqi (Jira)" <ji...@apache.org> on 2020/12/12 06:15:00 UTC
[jira] [Comment Edited] (YARN-10531) Be able to disable user limit
factor for CapacityScheduler Leaf Queue
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248297#comment-17248297 ]
zhuqi edited comment on YARN-10531 at 12/12/20, 6:14 AM:
---------------------------------------------------------
[~wangda] [~pbacsko] [~tangzhankun]
I submit a patch to support disable user limit factor for capacityScheduler leaf queue.
If you can review it.
Thanks.
was (Author: zhuqi):
[~wangda] [~pbacsko] [~tangzhankun]
I submit a patch to disable user limit factor for capacityScheduler leaf queue.
If you can review it.
Thanks.
> Be able to disable user limit factor for CapacityScheduler Leaf Queue
> ---------------------------------------------------------------------
>
> Key: YARN-10531
> URL: https://issues.apache.org/jira/browse/YARN-10531
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Wangda Tan
> Assignee: zhuqi
> Priority: Major
> Attachments: YARN-10531.001.patch
>
>
> User limit factor is used to define max cap of how much resource can be consumed by single user.
> Under Auto Queue Creation context, it doesn't make much sense to set user limit factor, because initially every queue will set weight to 1.0, we want user can consume more resource if possible. It is hard to pre-determine how to set up user limit factor. So it makes more sense to add a new value (like -1) to indicate we will disable user limit factor
> Logic need to be changed is below:
> (Inside LeafQueue.java)
> {code}
> Resource maxUserLimit = Resources.none();
> if (schedulingMode == SchedulingMode.RESPECT_PARTITION_EXCLUSIVITY) {
> maxUserLimit = Resources.multiplyAndRoundDown(queueCapacity,
> getUserLimitFactor());
> } else if (schedulingMode == SchedulingMode.IGNORE_PARTITION_EXCLUSIVITY) {
> maxUserLimit = partitionResource;
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org