You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Wangda Tan (JIRA)" <ji...@apache.org> on 2015/02/18 23:48:11 UTC

[jira] [Created] (YARN-3214) Adding non-exclusive node labels

Wangda Tan created YARN-3214:
--------------------------------

             Summary: Adding non-exclusive node labels 
                 Key: YARN-3214
                 URL: https://issues.apache.org/jira/browse/YARN-3214
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: capacityscheduler, resourcemanager
            Reporter: Wangda Tan
            Assignee: Wangda Tan


Currently node labels partition the cluster to some sub-clusters so resources cannot be shared between partitioned cluster. 

With the current implementation of node labels we cannot use the cluster optimally and the throughput of the cluster will suffer.

We are proposing adding non-exclusive node labels:

1. Labeled apps get the preference on Labeled nodes 
2. If there is no ask for labeled resources we can assign those nodes to non labeled apps
3. If there is any future ask for those resources , we will preempt the non labeled apps and give them back to labeled apps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)