You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Andras Gyori (Jira)" <ji...@apache.org> on 2021/06/09 11:41:00 UTC

[jira] [Created] (YARN-10813) Root queue capacity is not set when using node labels

Andras Gyori created YARN-10813:
-----------------------------------

             Summary: Root queue capacity is not set when using node labels
                 Key: YARN-10813
                 URL: https://issues.apache.org/jira/browse/YARN-10813
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Andras Gyori
            Assignee: Andras Gyori


CapacitySchedulerConfiguration#getNonLabeledQueueCapacity handles root in the following way:
{code:java}
if (absoluteResourceConfigured || configuredWeightAsCapacity(
        configuredCapacity)) {
      // Return capacity in percentage as 0 for non-root queues and 100 for
      // root.From AbstractCSQueue, absolute resource will be parsed and
      // updated. Once nodes are added/removed in cluster, capacity in
      // percentage will also be re-calculated.
      return queue.equals("root") ? 100.0f : 0f;
    }
{code}
CapacitySchedulerConfiguration#internalGetLabeledQueueCapacity on the other hand does not take root queue into consideration:
{code:java}
if (absoluteResourceConfigured || configuredWeightAsCapacity(
        configuredCapacity)) {
      // Return capacity in percentage as 0 for non-root queues and 100 for
      // root.From AbstractCSQueue, absolute resource, and weight will be parsed
      // and updated separately. Once nodes are added/removed in cluster,
      // capacity is percentage will also be re-calculated.
      return defaultValue;
    }

    float capacity = getFloat(capacityPropertyName, defaultValue);
{code}
Due to this, labeled root capacity is 0, which is not set in in AbstractCSQueue#derivedCapacityFromAbsoluteConfigurations, because root is never in Absolute mode.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org