[jira] [Created] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

["He Xiaoqiao (JIRA)" <ji...@apache.org>]

He Xiaoqiao created HDFS-13234:
----------------------------------

             Summary: Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client
                 Key: HDFS-13234
                 URL: https://issues.apache.org/jira/browse/HDFS-13234
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: fs, ha, hdfs-client
            Reporter: He Xiaoqiao


The memory footprint of #DFSClient is very considerable in some special scenario since there are many #Configuration instances and occupy much memory resource (In an extreme case, org.apache.hadoop.conf.Configuration occupies over 600MB we meet under HDFS Federation an HA with QJM and there are dozens of NameNodes). I think some new Configuration instance is not necessary. Such as  #ConfiguredFailoverProxyProvider initialization.

{code:java}
  public ConfiguredFailoverProxyProvider(Configuration conf, URI uri,
      Class<T> xface, HAProxyFactory<T> factory) {
    this.xface = xface;
    this.conf = new Configuration(conf);
    ......
  }
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org