You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Panagiotis Garefalakis (JIRA)" <ji...@apache.org> on 2017/12/21 18:10:00 UTC

[jira] [Updated] (YARN-7653) Node group support for AllocationTagsManager

     [ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Panagiotis Garefalakis updated YARN-7653:
-----------------------------------------
    Attachment: YARN-7653-YARN-6592.001.patch

Extending AllocationTagsManager to support Rack scope needed for our placement algorithm.
In order to do so, internal class NodeToCountedTags is now a generic mapping between Type T and a <Tag, Count>Map.
Manager is now holding both node and rack to ApplicationID and global counters.
Also added relevant test cases.

[~asuresh] [~kkaranasos] Please take a look

> Node group support for AllocationTagsManager
> --------------------------------------------
>
>                 Key: YARN-7653
>                 URL: https://issues.apache.org/jira/browse/YARN-7653
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Panagiotis Garefalakis
>            Assignee: Panagiotis Garefalakis
>         Attachments: YARN-7653-YARN-6592.001.patch
>
>
> AllocationTagsManager currently supports node and cluster-wide tag cardinality retrieval.
> If we want to support arbitrary node-groups/scopes for our placement constraints TagsManager should be extended to provide such functionality.
> As a first step we need to support RACK scope cardinality retrieval (as defined in our API).
> i.e. how many "spark" containers are currently running on "RACK-1"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org