You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Sandy Ryza (JIRA)" <ji...@apache.org> on 2013/10/10 20:47:46 UTC

[jira] [Updated] (MAPREDUCE-5575) History files deleted from the intermediate directory never get removed from the JobListCache

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sandy Ryza updated MAPREDUCE-5575:
----------------------------------

    Assignee: Niranjan Singh

> History files deleted from the intermediate directory never get removed from the JobListCache
> ---------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5575
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5575
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>    Affects Versions: 2.2.0
>            Reporter: Sandy Ryza
>            Assignee: Niranjan Singh
>
> The JobHistoryServer periodically scans through the intermediate directory. It adds all files to the JobListCache. It deletes job files that are older than the max age and moves all other files to the done directory.  Later, when files in the done directory become too old, they're deleted from the JobListCache.  Jobs that were deleted in the intermediate directory (and thus never moved to the done directory) end up in the JobListCache but can never be deleted from it.



--
This message was sent by Atlassian JIRA
(v6.1#6144)