You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2015/10/29 14:20:27 UTC

[jira] [Created] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

Junping Du created MAPREDUCE-6528:
-------------------------------------

             Summary: Memory leak for HistoryFileManager.getJobSummary()
                 Key: MAPREDUCE-6528
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6528
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver
            Reporter: Junping Du
            Assignee: Junping Du
            Priority: Critical


We meet memory leak issues for JHS in a large cluster which is caused by code below doesn't release FSDataInputStream in exception case. MAPREDUCE-6273 should fix most cases that exceptions get thrown. However, we still need to fix the memory leak for occasional case.

{code} 
private String getJobSummary(FileContext fc, Path path) throws IOException {
    Path qPath = fc.makeQualified(path);
    FSDataInputStream in = fc.open(qPath);
    String jobSummaryString = in.readUTF();
    in.close();
    return jobSummaryString;
  }
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)