You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "He Xiaoqiao (JIRA)" <ji...@apache.org> on 2018/03/07 10:06:00 UTC
[jira] [Commented] (HDFS-13234) Remove renew configuration instance
in ConfiguredFailoverProxyProvider and reduce memory footprint for client
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389346#comment-16389346 ]
He Xiaoqiao commented on HDFS-13234:
------------------------------------
upload patch v1 for trunk and pending jenkins.
> Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client
> -------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-13234
> URL: https://issues.apache.org/jira/browse/HDFS-13234
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: fs, ha, hdfs-client
> Reporter: He Xiaoqiao
> Priority: Major
> Attachments: HDFS-13234.001.patch
>
>
> The memory footprint of #DFSClient is very considerable in some special scenario since there are many #Configuration instances and occupy much memory resource (In an extreme case, org.apache.hadoop.conf.Configuration occupies over 600MB we meet under HDFS Federation an HA with QJM and there are dozens of NameNodes). I think some new Configuration instance is not necessary. Such as #ConfiguredFailoverProxyProvider initialization.
> {code:java}
> public ConfiguredFailoverProxyProvider(Configuration conf, URI uri,
> Class<T> xface, HAProxyFactory<T> factory) {
> this.xface = xface;
> this.conf = new Configuration(conf);
> ......
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org