You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2013/05/01 02:08:16 UTC

[jira] [Updated] (MAPREDUCE-5154) staging directory deletion fails because delegation tokens have been cancelled

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-5154:
-------------------------------------

    Attachment: MAPREDUCE-5154.patch

[~sandyr] This is the fix I had in mind. LMK what you think. Thanks.
                
> staging directory deletion fails because delegation tokens have been cancelled
> ------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5154
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5154
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 1.2.0
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: MAPREDUCE-5154.patch, MAPREDUCE-5154.patch
>
>
> In a secure setup, the jobtracker needs the job's delegation tokens to delete the staging directory.  MAPREDUCE-4850 made it so that job cleanup staging directory deletion occurs asynchronously, so that it could order it with system directory deletion.  This introduced the issue that a job's delegation tokens could be cancelled before the cleanup thread got around to deleting it, causing the deletion to fail.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira