You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Maksim Logvinenko (JIRA)" <ji...@apache.org> on 2016/09/05 17:02:20 UTC

[jira] [Created] (SAMZA-1013) Add YARN Node label support

Maksim Logvinenko created SAMZA-1013:
----------------------------------------

             Summary: Add YARN Node label support
                 Key: SAMZA-1013
                 URL: https://issues.apache.org/jira/browse/SAMZA-1013
             Project: Samza
          Issue Type: Improvement
            Reporter: Maksim Logvinenko


YARN Node labels were introduced in Hadoop version 2.6, which allows to group nodes with similar characteristics and allows applications to specify where to run. This patch adds support for YARN node labels in Samza.

In this implementation, node labels are defined directly in yarnConfig in YarnClusterResourceManager. It might be better to have node labels as a part of SamzaResourceRequest and SamzaResource classes, but org.apache.hadoop.yarn.api.records.Container class doesn't contain node label and hence we have nothing to pass to the SamzaResource constructor in onContainersAllocated method of YarnClusterResourceManager class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)