You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2017/01/06 00:53:59 UTC

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Junping Du updated MAPREDUCE-6528:
----------------------------------
    Fix Version/s: 2.8.0

> Memory leak for HistoryFileManager.getJobSummary()
> --------------------------------------------------
>
>                 Key: MAPREDUCE-6528
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6528
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>            Reporter: Junping Du
>            Assignee: Junping Du
>            Priority: Critical
>             Fix For: 2.8.0, 2.7.2, 2.6.3, 3.0.0-alpha1
>
>         Attachments: MAPREDUCE-6528.patch
>
>
> We meet memory leak issues for JHS in a large cluster which is caused by code below doesn't release FSDataInputStream in exception case. MAPREDUCE-6273 should fix most cases that exceptions get thrown. However, we still need to fix the memory leak for occasional case.
> {code} 
> private String getJobSummary(FileContext fc, Path path) throws IOException {
>     Path qPath = fc.makeQualified(path);
>     FSDataInputStream in = fc.open(qPath);
>     String jobSummaryString = in.readUTF();
>     in.close();
>     return jobSummaryString;
>   }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org