You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Lei Guo (JIRA)" <ji...@apache.org> on 2015/07/07 16:36:07 UTC

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

    [ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616787#comment-14616787 ] 

Lei Guo commented on YARN-2915:
-------------------------------

Does this design also consider multiple data center case? Though the idea is relatively generic, could be applied in either single data center or multiple data center, but in real production environment, we have to consider network latency and data locality across data center. The central state store could be a new bottleneck.

> Enable YARN RM scale out via federation using multiple RM's
> -----------------------------------------------------------
>
>                 Key: YARN-2915
>                 URL: https://issues.apache.org/jira/browse/YARN-2915
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Sriram Rao
>            Assignee: Subru Krishnan
>         Attachments: Yarn_federation_design_v1.pdf
>
>
> This is an umbrella JIRA that proposes to scale out YARN to support large clusters comprising of tens of thousands of nodes.   That is, rather than limiting a YARN managed cluster to about 4k in size, the proposal is to enable the YARN managed cluster to be elastically scalable.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)