You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Naganarasimha G R (JIRA)" <ji...@apache.org> on 2017/07/26 20:51:02 UTC

[jira] [Comment Edited] (YARN-3409) Support Node Attribute functionality

    [ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102204#comment-16102204 ] 

Naganarasimha G R edited comment on YARN-3409 at 7/26/17 8:50 PM:
------------------------------------------------------------------

Thanks [~kkaranasos], 
One last suggestion whether it make more meaningful to have the type with the attribute name or the value ?
{{node1:java=8(string),ssd=false(boolean)}}  vs {{node1:java(string)=8,ssd(boolean)=false}}  and default being string if not specified ? 
IMO later suits to indicate the back end validation that a given attribute mapped to a node should not violate any existing attribute (name to type pair) mapped to any node.
 


was (Author: naganarasimha):
Thanks [~kkaranasos], 
One last suggestion whether it make more meaningful to have the type with the attribute name or the value ?
{{node1:java=8(string),ssd=false(boolean)}}  vs {{node1:java(string)=8,ssd(boolean)=false}}  and default being string if not specified ? 
 

> Support Node Attribute functionality
> ------------------------------------
>
>                 Key: YARN-3409
>                 URL: https://issues.apache.org/jira/browse/YARN-3409
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: api, capacityscheduler, client
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
>         Attachments: 3409-apiChanges_v2.pdf (4).pdf, Constraint-Node-Labels-Requirements-Design-doc_v1.pdf, YARN-3409.WIP.001.patch
>
>
> Specify only one label for each node (IAW, partition a cluster) is a way to determinate how resources of a special set of nodes could be shared by a group of entities (like teams, departments, etc.). Partitions of a cluster has following characteristics:
> - Cluster divided to several disjoint sub clusters.
> - ACL/priority can apply on partition (Only market team / marke team has priority to use the partition).
> - Percentage of capacities can apply on partition (Market team has 40% minimum capacity and Dev team has 60% of minimum capacity of the partition).
> Attributes are orthogonal to partition, they’re describing features of node’s hardware/software just for affinity. Some example of attributes:
> - glibc version
> - JDK version
> - Type of CPU (x86_64/i686)
> - Type of OS (windows, linux, etc.)
> With this, application can be able to ask for resource has (glibc.version >= 2.20 && JDK.version >= 8u20 && x86_64).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org