You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2011/08/10 23:59:27 UTC
[jira] [Created] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
"Creation of symlink to attempt log dir failed." message is not useful
----------------------------------------------------------------------
Key: MAPREDUCE-2804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.204.0
Reporter: Allen Wittenauer
Priority: Blocker
In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated MAPREDUCE-2804:
-------------------------------------
Attachment: mr-2804-205.patch
The patch conflicted with HADOOP-7100, so here is the proposed updated patch.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804-205.patch, mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090378#comment-13090378 ]
Allen Wittenauer commented on MAPREDUCE-2804:
---------------------------------------------
+1
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082907#comment-13082907 ]
Ravi Gummadi commented on MAPREDUCE-2804:
-----------------------------------------
MAPREDUCE-2415 distributed the userlogs on to multiple disks. Its implementation relies on this symlink creation from attempt-directory of (older) userlogs directory to attempt-directory on one of the multiple disks.
The design doc attached to MAPREDUCE-2415 can give more details.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094870#comment-13094870 ]
Devaraj Das commented on MAPREDUCE-2804:
----------------------------------------
+1 for the branch-0.20-security patch.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.20.204.0
>
> Attachments: mr-2804-205.patch, mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated MAPREDUCE-2804:
-------------------------------------
Status: Patch Available (was: Open)
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082705#comment-13082705 ]
Allen Wittenauer commented on MAPREDUCE-2804:
---------------------------------------------
This came as part of the changes in 204. I can't find the same message in 203.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated MAPREDUCE-2804:
-------------------------------------
Attachment: mr-2804.patch
Fundamentally, there were two problems:
1. The logging message was less than useful.
2. There is a race condition when java's primitives are used to change permissions on a file.
This patch fixes the log messages to be much clearer about what is going wrong and removes the extra chmod of the job directory. It was that chmod that was causing the creation of the symlinks of a different task to fail when they were launching at the same time.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated MAPREDUCE-2804:
-------------------------------------
Resolution: Fixed
Fix Version/s: 0.20.204.0
Release Note: Removed duplicate chmods of job log dir that were vulnerable to race conditions between tasks. Also improved the messages when the symlinks failed to be created.
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.20.204.0
>
> Attachments: mr-2804-205.patch, mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082968#comment-13082968 ]
Allen Wittenauer commented on MAPREDUCE-2804:
---------------------------------------------
Thanks. Now we know the source of the patch that introduced this message.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13091265#comment-13091265 ]
Owen O'Malley commented on MAPREDUCE-2804:
------------------------------------------
Oops, that should be HADOOP-7110.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804-205.patch, mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley reassigned MAPREDUCE-2804:
----------------------------------------
Assignee: Owen O'Malley
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090407#comment-13090407 ]
Devaraj Das commented on MAPREDUCE-2804:
----------------------------------------
+1
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
> Attachments: mr-2804.patch
>
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088043#comment-13088043 ]
Owen O'Malley commented on MAPREDUCE-2804:
------------------------------------------
I found it and will generate a patch this afternoon.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2804) "Creation of symlink to attempt
log dir failed." message is not useful
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088018#comment-13088018 ]
Owen O'Malley commented on MAPREDUCE-2804:
------------------------------------------
I'm seeing this one too. Interestingly, it seems to be reported for a task that finishes without problem. But another task that is starting at the same time fails with no logs and no explanation.
> "Creation of symlink to attempt log dir failed." message is not useful
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2804
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2804
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.204.0
> Reporter: Allen Wittenauer
> Assignee: Owen O'Malley
> Priority: Blocker
>
> In attempting to qualify the 204 RC2 release, my tasktracker logs are filled with the above message. I'd love to do something about it, but since it doesn't tell me what exactly it is trying to symlink I cannot unless I dig into the source code.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira