You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Andras Gyori (Jira)" <ji...@apache.org> on 2021/06/16 08:36:00 UTC

[jira] [Updated] (YARN-10813) Set default capacity of root for node labels

     [ https://issues.apache.org/jira/browse/YARN-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andras Gyori updated YARN-10813:
--------------------------------
    Summary: Set default capacity of root for node labels  (was: Root queue capacity is not set when using node labels)

> Set default capacity of root for node labels
> --------------------------------------------
>
>                 Key: YARN-10813
>                 URL: https://issues.apache.org/jira/browse/YARN-10813
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Andras Gyori
>            Assignee: Andras Gyori
>            Priority: Major
>         Attachments: YARN-10813.001.patch
>
>
> CapacitySchedulerConfiguration#getNonLabeledQueueCapacity handles root in the following way:
> {code:java}
> if (absoluteResourceConfigured || configuredWeightAsCapacity(
>         configuredCapacity)) {
>       // Return capacity in percentage as 0 for non-root queues and 100 for
>       // root.From AbstractCSQueue, absolute resource will be parsed and
>       // updated. Once nodes are added/removed in cluster, capacity in
>       // percentage will also be re-calculated.
>       return queue.equals("root") ? 100.0f : 0f;
>     }
> {code}
> CapacitySchedulerConfiguration#internalGetLabeledQueueCapacity on the other hand does not take root queue into consideration:
> {code:java}
> if (absoluteResourceConfigured || configuredWeightAsCapacity(
>         configuredCapacity)) {
>       // Return capacity in percentage as 0 for non-root queues and 100 for
>       // root.From AbstractCSQueue, absolute resource, and weight will be parsed
>       // and updated separately. Once nodes are added/removed in cluster,
>       // capacity is percentage will also be re-calculated.
>       return defaultValue;
>     }
>     float capacity = getFloat(capacityPropertyName, defaultValue);
> {code}
> Due to this, labeled root capacity is 0, which is not set in in AbstractCSQueue#derivedCapacityFromAbsoluteConfigurations, because root is never in Absolute mode.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org