[jira] [Commented] (MAPREDUCE-4167) Delete empty timestamped directories

["Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258278#comment-13258278 ] 

Robert Joseph Evans commented on MAPREDUCE-4167:
------------------------------------------------

I saw this too, The difficult part with this is debug mode in the history server.  It switches the YYYY/MM/DD to YYYY/HH/mm (or something like that).  This makes it very difficult for the cleanup code to be able to know when it is allowed to delete a particular directory.  It is possible, however unlikely, that the cleanup thread would try to delete a directory at the same time that someone else is trying to add something to them.  This could potentially result in files being deleted that should not be.  It should not be too hard to work around it, but it is something to be aware of.
                
> Delete empty timestamped directories
> ------------------------------------
>
>                 Key: MAPREDUCE-4167
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4167
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, mrv2
>    Affects Versions: 2.0.0, trunk
>            Reporter: Bhallamudi Venkata Siva Kamesh
>
> Currently in the clean() method, we are deleting only the files/directories inside *YYYY/MM/DD* directory and leaving those time  stamped directories (*YYYY/MM/DD*) as it is. As these are empty directories, I *think*, we should delete these time stamped directories from FileSystem in the clean method.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira