You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "shanyu zhao (JIRA)" <ji...@apache.org> on 2014/07/15 23:00:06 UTC

[jira] [Created] (HADOOP-10840) Fix OutOfMemoryError caused by metrics system in Azure File System

shanyu zhao created HADOOP-10840:
------------------------------------

             Summary: Fix OutOfMemoryError caused by metrics system in Azure File System
                 Key: HADOOP-10840
                 URL: https://issues.apache.org/jira/browse/HADOOP-10840
             Project: Hadoop Common
          Issue Type: Bug
          Components: metrics
    Affects Versions: 2.4.1
            Reporter: shanyu zhao
            Assignee: shanyu zhao


In Hadoop 2.x the Hadoop File System framework changed and no cache is implemented (refer to HADOOP-6356). This means for every WASB access, a new NativeAzureFileSystem is created, along which a Metrics source created and added to MetricsSystemImpl. Over time the sources accumulated, eating memory and causing Java OutOfMemoryError.

The fix is to utilize the unregisterSource() method added to MetricsSystem in HADOOP-10839.



--
This message was sent by Atlassian JIRA
(v6.2#6252)