You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2016/05/18 04:28:12 UTC
[jira] [Commented] (HDFS-10421) The nameservice for a Hadoop
Namenode HA should be discoverable across clusters
[ https://issues.apache.org/jira/browse/HDFS-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15288190#comment-15288190 ]
Allen Wittenauer commented on HDFS-10421:
-----------------------------------------
I hate that the HDFS folks and the YARN folks don't talk to each other.
YARN-4757
> The nameservice for a Hadoop Namenode HA should be discoverable across clusters
> -------------------------------------------------------------------------------
>
> Key: HDFS-10421
> URL: https://issues.apache.org/jira/browse/HDFS-10421
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: ha, hdfs-client
> Reporter: Mahipal Jupalli
> Priority: Minor
>
> Name service configured in NameNode HA mode, should be discoverable across clusters without having to restart all the clusters every time a new cluster is deployed.
> Solution #1: One solution would be to add the nameservice configurations to all the hdfs-site.xml files in the clusters involved.
> Cons: We cannot restart all clusters every time we deploy a new cluster.
> We are developing a custom class to extend org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider, this custom provider will make a REST call to fetch any additional nameservice configurations and cache them locally (expires on a configured time limit). This will fix the issue to resolve the name service across clusters and also eliminate the need to restart all the clusters whenever a new cluster is configured.
> Please provide your inputs. Wondering if this would be a good feature to add and if so please assign this to me. I can contribute to this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org