You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Voyta (JIRA)" <ji...@apache.org> on 2018/04/17 10:09:00 UTC
[jira] [Created] (HADOOP-15392) S3A Metrics in S3AInstrumentation
Cause Memory Leaks
Voyta created HADOOP-15392:
------------------------------
Summary: S3A Metrics in S3AInstrumentation Cause Memory Leaks
Key: HADOOP-15392
URL: https://issues.apache.org/jira/browse/HADOOP-15392
Project: Hadoop Common
Issue Type: Bug
Components: fs/s3
Affects Versions: 3.1.0
Reporter: Voyta
While using HBase S3A Export Snapshot utility we started to experience memory leaks of the process after version upgrade.
By running code analysis we traced the cause to revision 6555af81a26b0b72ec3bee7034e01f5bd84b1564 that added the following static reference (singleton):
private static MetricsSystem metricsSystem = null;
When application uses S3AFileSystem instance that is not closed immediately metrics are accumulated in this instance and memory grows without any limit.
Expectation:
* It would be nice to have an option to disable metrics completely as this is not needed for Export Snapshot utility.
* Usage of S3AFileSystem should not contain any static object that can grow indefinitely.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org