You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Brahma Reddy Battula (Jira)" <ji...@apache.org> on 2020/05/05 06:04:00 UTC

[jira] [Commented] (YARN-10246) Enable Yarn Router to have a dedicated Zookeeper

    [ https://issues.apache.org/jira/browse/YARN-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099548#comment-17099548 ] 

Brahma Reddy Battula commented on YARN-10246:
---------------------------------------------

[~dmmkr] thanks for reporting this. Make to sense to have different ZK statestore for Federation.

[~subru]/[~bibinchundatt] looks you had discussed on this topic in YARN-5597,any thoughts on this apporach..?

.[~inigoiri]  this can used in HDFS router also.?

 

[~dmmkr] Looks you missed to update "isFederationZkCurator" in the following.
|66|this.isFederationZkCurator = true;|

> Enable Yarn Router to have a dedicated Zookeeper
> ------------------------------------------------
>
>                 Key: YARN-10246
>                 URL: https://issues.apache.org/jira/browse/YARN-10246
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: federation, router
>            Reporter: D M Murali Krishna Reddy
>            Assignee: D M Murali Krishna Reddy
>            Priority: Major
>         Attachments: YARN-10246.001.patch
>
>
> Currently, we have a single parameter hadoop.zk.address for Router and Resourcemanager, Due to this we need have FederationStateStore and RMStateStore on the same Zookeeper instance. 
> With the above topology there can be a load on ZooKeeper, since all subcluster RMs will write to single ZooKeeper.
> So, If we Introduce a new configuration such as hadoop.federation.zk.address we can have FederationStateStore on a dedicated Zookeeper.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org