You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "zhuqi (Jira)" <ji...@apache.org> on 2021/01/12 15:33:01 UTC
[jira] [Comment Edited] (YARN-10564) Support Auto Queue Creation
template configurations
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263426#comment-17263426 ]
zhuqi edited comment on YARN-10564 at 1/12/21, 3:32 PM:
--------------------------------------------------------
[~leftnoteasy] [~gandras]
Add an auto create with template poc patch, combined with YARN-10506-008.patch for test.
The poc just handle template related conf, next we should reuse or extend AutoCreatedQueueManagementPolicy and realize the related logic.
The test is in :
testAutoCreateQueueWithTemplateWeight function.
Thanks.
was (Author: zhuqi):
[~leftnoteasy] [~gandras]
Add an auto create with template poc patch, combined with YARN-10506-008.patch for test.
The poc just handle template related conf, next we should reuse or extend AutoCreatedQueueManagementPolicy and realize the related logic.
> Support Auto Queue Creation template configurations
> ---------------------------------------------------
>
> Key: YARN-10564
> URL: https://issues.apache.org/jira/browse/YARN-10564
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Andras Gyori
> Assignee: Andras Gyori
> Priority: Major
> Attachments: YARN-10564.poc.001.patch
>
>
> Similar to how the template configuration works for ManagedParents, we need to support templates for the new auto queue creation logic. Proposition is to allow wildcards in template configs such as:
> {noformat}
> yarn.scheduler.capacity.root.*.*.weight 10{noformat}
> which would mean, that set weight to 10 of every leaf of every parent under root.
> We should possibly take an approach, that could support arbitrary depth of template configuration, because we might need to lift the limitation of auto queue nesting.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org