You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/23 20:55:39 UTC
[jira] [Commented] (MAPREDUCE-721) When
"mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files
are not getting deleted after that x hours.It gets deleted after some
random hours which is greater than x hours.
[ https://issues.apache.org/jira/browse/MAPREDUCE-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072138#comment-14072138 ]
Allen Wittenauer commented on MAPREDUCE-721:
--------------------------------------------
It would appear this documentation bug is also present in all the accompanying vendor documentation too. Not sure we care now though.
> When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours which is greater than x hours.
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-721
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-721
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: documentation
> Reporter: Iyappan Srinivasan
> Labels: newbie
>
> When "mapred.job.tracker.persist.jobstatus.hours" is set to 1 hour, the jobid files, present in configured directory, are not getting deleted after that 1 hour. It gets deleted after some random hours.
> This is irrespective of whether "mapred.job.tracker.persist.jobstatus.dir" is set to local file system or DFS.
> Steps to reproduce the issue:
> 1) Im mapred-site.xml,
> Set "mapred.job.tracker.persist.jobstatus.active" to "true"
> Set "mapred.job.tracker.persist.jobstatus.hours" to "1"
> Set "mapred.job.tracker.persist.jobstatus.dir" to either a local file syste by preixing it with file:/// or dfs by giving a dfs directory without the "file:///"
> 2) After that run any job.
> 3) After it is complete the job id file comes in the configured directory.
> 4) Wait for one hour
> 5) Observe After 1 hour the files are not deleted.
> 6) After some random hours, files gets deleted.
--
This message was sent by Atlassian JIRA
(v6.2#6252)