You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Tao Yang (Jira)" <ji...@apache.org> on 2021/09/01 02:47:00 UTC
[jira] [Commented] (YARN-10928) Support default queue properties of
capacity scheduler to simplify configuration management
[ https://issues.apache.org/jira/browse/YARN-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407775#comment-17407775 ]
Tao Yang commented on YARN-10928:
---------------------------------
Thanks [~Weihao Zheng] for filling this ticket!
I think it's very useful for cluster management, and it's reasonable to use the non-specified-queue configuration as some cluster-level configurations already did (e.g. yarn.scheduler.capacity.maximum-applications / yarn.scheduler.capacity.maximum-am-resource-percent / yarn.scheduler.capacity.max-parallel-apps).
For the PR, I think it's better to add a simple UT in TestApplicationLimit and make sure the related document is updated.
> Support default queue properties of capacity scheduler to simplify configuration management
> -------------------------------------------------------------------------------------------
>
> Key: YARN-10928
> URL: https://issues.apache.org/jira/browse/YARN-10928
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
> Reporter: Weihao Zheng
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> There are many user cases that one user owns many queues in his organization's cluster for different business usages in practice. These queues often share the same properties, such as minimum-user-limit-percent and user-limit-factor. Users have to write one property for every queue they use if they want to use customized these shared properties. Adding default queue properties for these cases will simplify capacity scheduler's configuration file and make it easy to adjust queue's common properties.
>
> CHANGES:
> Add two properties as queue's default value in capacity scheduler's configuration:
> * {{yarn.scheduler.capacity.minimum-user-limit-percent}}
> * {{yarn.scheduler.capacity.user-limit-factor}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org