You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "He Xiaoqiao (JIRA)" <ji...@apache.org> on 2019/08/06 03:36:00 UTC

[jira] [Updated] (HDFS-14702) Datanode.ReplicaMap memory leak

     [ https://issues.apache.org/jira/browse/HDFS-14702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Xiaoqiao updated HDFS-14702:
-------------------------------
    Attachment: datanode.dump.png

> Datanode.ReplicaMap memory leak
> -------------------------------
>
>                 Key: HDFS-14702
>                 URL: https://issues.apache.org/jira/browse/HDFS-14702
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.7.1
>            Reporter: He Xiaoqiao
>            Priority: Major
>         Attachments: datanode.dump.png
>
>
> DataNode memory is occupied by ReplicaMaps and cause GC high frequency then write performance degrade.
> It is about 600K block replicas located at DataNode, but when dump heap, there are over 8M items of ReplicaMaps and footprint over 500MB. It seems that memory leak. One more situation, the block w/r ops is very high.
> Do not test HDFS-8859 and no idea if it can solve this issue.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org