You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Benjamin Teke (Jira)" <ji...@apache.org> on 2021/01/07 07:54:00 UTC
[jira] [Comment Edited] (YARN-10504) Implement weight mode in
Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260292#comment-17260292 ]
Benjamin Teke edited comment on YARN-10504 at 1/7/21, 7:53 AM:
---------------------------------------------------------------
[~wangda],
Regarding the AutoCreatedLeafQueue failures: we are looking into the issue. Currently it seems like the way the mock setup is structured the updateClusterResource is not called at the correct time. We'll update the patch once the issue is verified and fixed.
was (Author: bteke):
[~wangda],
Regarding the AutoCreatedLeafQueue: we are looking into the issue. Cuurently it seems like the way the mock setup is structured the updateClusterResource is not called at the correct time. We'll update the patch once the issue is fixed.
> Implement weight mode in Capacity Scheduler
> -------------------------------------------
>
> Key: YARN-10504
> URL: https://issues.apache.org/jira/browse/YARN-10504
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Benjamin Teke
> Assignee: Benjamin Teke
> Priority: Major
> Attachments: YARN-10504.001.patch, YARN-10504.002.patch, YARN-10504.ver-1.patch, YARN-10504.ver-2.patch, YARN-10504.ver-3.patch
>
>
> To allow the possibility to flexibly create queues in Capacity Scheduler a weight mode should be introduced. The existing \{{capacity }}property should be used with a different syntax, i.e:
> root.users.capacity = (1.0) or ~1.0 or ^1.0 or @1.0
> root.users.capacity = 1.0w
> root.users.capacity = w:1.0
> Weight support should not impact the existing functionality.
>
> The new functionality should:
> * accept and validate the new weight values
> * enforce a singular mode on the whole queue tree
> * (re)calculate the relative (percentage-based) capacities based on the weights during launch and every time the queue structure changes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org