You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2012/06/05 09:41:24 UTC
[jira] [Resolved] (MAPREDUCE-4246) Failure in deleting user
directories in Secure hadoop
[ https://issues.apache.org/jira/browse/MAPREDUCE-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko resolved MAPREDUCE-4246.
--------------------------------------------
Resolution: Fixed
Target Version/s: 0.22.1
Hadoop Flags: Reviewed
+1
I just committed this to branch 0.22.1. Thank you Benoy.
> Failure in deleting user directories in Secure hadoop
> -----------------------------------------------------
>
> Key: MAPREDUCE-4246
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4246
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: security
> Affects Versions: 0.22.0
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 0.22.1
>
> Attachments: cleanup-user-dir.patch
>
>
> This happens when security is enabled on 22
> When TaskTracker starts p, it invokes MRAsyncDiskService moves the contents of scratch/tasktracker to toBeDeleted under a directory created with the current timestamp.
> The owner of this directory is hadoop (owner of tasktracker)
> The contents of this directory are various usernames and they are owned by individual users. But MRAsyncDiskService tries to delete the newly created directory as hadoop and it fails.
> 2012-05-01 16:04:58,805 DEBUG org.apache.hadoop.mapred.LinuxTaskController: deleteAsUser: [/apache/hadoop-assemble-argon-0.228/hadoop-0.22-argon-0.105/bin/../bin/task-controller, hadoop, 3, /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0]
> 2012-05-01 16:04:58,809 WARN org.apache.hadoop.mapreduce.util.MRAsyncDiskService: Failure in deletion of toBeDeleted/2012-04-17_16-22-03.965_0 on /hadoop00/scratch with original name /hadoop00/scratch/toBeDeleted/2012-04-17_16-22-03.965_0 with exception org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:256)
> at org.apache.hadoop.util.Shell.run(Shell.java:183)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:376)
> at org.apache.hadoop.mapred.LinuxTaskController.deleteAsUser(LinuxTaskController.java:273)
> at org.apache.hadoop.mapreduce.util.MRAsyncDiskService$DeleteTask.run(MRAsyncDiskService.java:237)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira