You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2018/02/03 01:02:00 UTC
[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore
for RM HA
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351142#comment-16351142 ]
Vinod Kumar Vavilapalli commented on YARN-7497:
-----------------------------------------------
How does this related to the ConfigurationProvider interface and the corresponding HDFS implementation done at YARN-1611?
If their goals are the same, it's high time we merge these interfaces via YARN-7571.
> Add HDFSSchedulerConfigurationStore for RM HA
> ---------------------------------------------
>
> Key: YARN-7497
> URL: https://issues.apache.org/jira/browse/YARN-7497
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Jiandan Yang
> Assignee: Jiandan Yang
> Priority: Major
> Attachments: YARN-7497.001.patch, YARN-7497.002.patch, YARN-7497.003.patch, YARN-7497.004.patch, YARN-7497.005.patch, YARN-7497.006.patch
>
>
> YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but it does not support Yarn RM HA.
> YARN-6840 supports RM HA, but too many scheduler configurations may exceed znode limit, for example 10 thousand queues.
> HDFSSchedulerConfigurationStore store conf file in HDFS, when RM failover, new active RM can load scheduler configuration from HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org