You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org> on 2011/10/17 08:28:11 UTC
[jira] [Updated] (MAPREDUCE-2762) [MR-279] - Cleanup staging dir
after job completion
[ https://issues.apache.org/jira/browse/MAPREDUCE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-2762:
-------------------------------------
Attachment: MAPREDUCE-2762.patch
Changed the patch to do cleanup after calling stop on all services in MRAppMaster.
- Added a job cleanup event which is synchronously called from the MRAppMaster Jobfinished handler.
We could also add a job api for cleanupo but either of those are not very clean implementation. The more I think, the earlier suggestion on sending events for de registering and then cleanup is probably much cleaner.
> [MR-279] - Cleanup staging dir after job completion
> ---------------------------------------------------
>
> Key: MAPREDUCE-2762
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2762
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ramya Sunil
> Assignee: Mahadev konar
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2762.patch, MAPREDUCE-2762.patch, MAPREDUCE-2762.patch, MAPREDUCE-2762.patch
>
>
> The files created under the staging dir have to be deleted after job completion. Currently, all job.* files remain forever in the ${yarn.apps.stagingDir}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira