You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Benjamin Teke (Jira)" <ji...@apache.org> on 2021/01/26 14:33:00 UTC
[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation:
Modify RM /scheduler endpoint to extend the creation type with additional
information
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benjamin Teke updated YARN-10598:
---------------------------------
Description:
Under this umbrella (YARN-10496), weight-mode has been implemented for CS with YARN-10504.
Auto-queue creation has been also implemented with YARN-10506.
Connected to this effort, we would like to expose the type of the queue with the RM's /scheduler REST endpoint.
To extend/modify the values added in YARN-10581 these 3 fields will describe a queue:
* queueType : *parent/leaf*
* creationMethod : *static/dynamicLegacy/dynamicFlexible*
* autoCreationEligibility : *off/legacy/flexible*
After this change here are some example cases:
* Static parent queue which has the auto-creation-enabled-v2 false:
** queueType : *parent*
** creationMethod : *static*
** autoCreationEligibility : *off*
* **Static managed parent (can have dynamic children):
** queueType : *parent*
** creationMethod : *static*
** autoCreationEligibility : *legacy*
* Legacy auto-created leaf queue (cannot have children):
** queueType : *leaf*
** creationMethod : *dynamicLegacy*
** autoCreationEligibility : *off*
* Auto-created (v2) parent queue, auto-creation-enabled-v2 true:
** queueType : *parent*
** creationMethod : *dynamicFlexible*
** autoCreationEligibility : *flexible*
* Auto-created (v2) leaf queue (cannot have children):
** queueType : *leaf*
** creationMethod : *dynamicFlexible*
** autoCreationEligibility : *off*
was:
Under this umbrella (YARN-10496), weight-mode has been implemented for CS with YARN-10504.
Auto-queue creation has been also imlemented with YARN-10506.
Connected to this effort, we would like to expose the type of the queue with the RM's /scheduler REST endpoint.
The queue type should hold these values:
* Auto-created parent queue: *autoCreatedParent*
* Auto-created leaf queue: *autoCreatedLeaf*
* Static parent: *staticParent*
* Static leaf: *staticLeaf*
> CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information
> ----------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-10598
> URL: https://issues.apache.org/jira/browse/YARN-10598
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Benjamin Teke
> Assignee: Benjamin Teke
> Priority: Major
>
> Under this umbrella (YARN-10496), weight-mode has been implemented for CS with YARN-10504.
> Auto-queue creation has been also implemented with YARN-10506.
> Connected to this effort, we would like to expose the type of the queue with the RM's /scheduler REST endpoint.
> To extend/modify the values added in YARN-10581 these 3 fields will describe a queue:
> * queueType : *parent/leaf*
> * creationMethod : *static/dynamicLegacy/dynamicFlexible*
> * autoCreationEligibility : *off/legacy/flexible*
> After this change here are some example cases:
> * Static parent queue which has the auto-creation-enabled-v2 false:
> ** queueType : *parent*
> ** creationMethod : *static*
> ** autoCreationEligibility : *off*
> * **Static managed parent (can have dynamic children):
> ** queueType : *parent*
> ** creationMethod : *static*
> ** autoCreationEligibility : *legacy*
> * Legacy auto-created leaf queue (cannot have children):
> ** queueType : *leaf*
> ** creationMethod : *dynamicLegacy*
> ** autoCreationEligibility : *off*
> * Auto-created (v2) parent queue, auto-creation-enabled-v2 true:
> ** queueType : *parent*
> ** creationMethod : *dynamicFlexible*
> ** autoCreationEligibility : *flexible*
> * Auto-created (v2) leaf queue (cannot have children):
> ** queueType : *leaf*
> ** creationMethod : *dynamicFlexible*
> ** autoCreationEligibility : *off*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org