You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Aihua Xu (JIRA)" <ji...@apache.org> on 2019/01/15 00:47:00 UTC

[jira] [Created] (YARN-9200) Enable resource configuration of queue capacity for different resources independently

Aihua Xu created YARN-9200:
------------------------------

             Summary: Enable resource configuration of queue capacity for different resources independently
                 Key: YARN-9200
                 URL: https://issues.apache.org/jira/browse/YARN-9200
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacity scheduler
    Affects Versions: 3.1.0
            Reporter: Aihua Xu


In capacity scheduler, currently two resource allocations are supported. 1. percentage allocation for child queues -  the child queue gets a defined percentage of the resources for all the resource types; 2. absolute values  (YARN-5881) - each resource is configured an absolute values.

Right now we can't mix these case together and it would also very confusing to mix them in one cluster. The second case actually is more targeting toward cloud env. 

In a non-cloud env, the ability to configure each resource independently is also useful, but in such env, percentage is preferable instead of absolute value. One thought here is to add the percentage configuration for each resource type on the queue. That would allow us to configure memory bounded queues, or CPU bounded queues. 





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org