You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj Das (JIRA)" <ji...@apache.org> on 2010/01/18 19:50:54 UTC
[jira] Created: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
-----------------------------------------------------------------------------
Key: MAPREDUCE-1385
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
Project: Hadoop Map/Reduce
Issue Type: New Feature
Reporter: Devaraj Das
Assignee: Devaraj Das
Fix For: 0.22.0
This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806694#action_12806694 ]
Hudson commented on MAPREDUCE-1385:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #221 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/221/])
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated MAPREDUCE-1385:
-----------------------------------
Attachment: mr-6299.8.patch
Tests pass with this patch.
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841431#action_12841431 ]
Hudson commented on MAPREDUCE-1385:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #248 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/248/])
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805402#action_12805402 ]
Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------
+1
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804812#action_12804812 ]
Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------
The following code from Cluster.java and ClusterWithLinuxTaskController is a no-op:
{noformat}
UserGroupInformation.getCurrentUser().doAs(...)
{noformat}
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804754#action_12804754 ]
Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------
Please use the long form of the user name rather than the short form in spots like:
{noformat}
- JobInfo jobInfo = new JobInfo(jobId, new Text(ugi.getUserName()),
+ JobInfo jobInfo = new JobInfo(jobId, new Text(ugi.getShortUserName()),
{noformat}
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804746#action_12804746 ]
Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------
Please add a call to UserGroupInformation.setConfiguration at the start of the JobTracker, and TaskTracker so that UGI uses the same configuration object. The Task should also use setConfiguration with the job's configuration.
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828466#action_12828466 ]
Hudson commented on MAPREDUCE-1385:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #225 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/225/])
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated MAPREDUCE-1385:
-----------------------------------
Attachment: mr-6299.3.patch
The earlier patch went out of sync. Updated patch.
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley resolved MAPREDUCE-1385.
--------------------------------------
Resolution: Fixed
Hadoop Flags: [Incompatible change, Reviewed]
I just committed this. Thanks, Devaraj!
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840519#action_12840519 ]
Hudson commented on MAPREDUCE-1385:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #255 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/255/])
MAPREDUCE-1421. LinuxTaskController tests failing on trunk after the commit of . Contributed by Amareshwari Sriramadasu.
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for
the new UserGroupInformation APIs (HADOOP-6299)
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805342#action_12805342 ]
Devaraj Das commented on MAPREDUCE-1385:
----------------------------------------
Ok i could run findbugs on this patch and confirmed that it doesn't add any new warnings. I also ran javadoc and javac-warnings ones. No new warnings there too. I am sure I didn't introduce any new release audit warnings since there are no new files in the patch. Same for @author tags. It is almost impossible to run the stand-alone test-patch command, as it exists today, on this patch.
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated MAPREDUCE-1385:
-----------------------------------
Attachment: mr-6299.7.patch
Patch that addresses Owen's concerns. Running tests now. Running test-patch proved to be a real pain. Still trying to run it..
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the
new UserGroupInformation APIs (HADOOP-6299)
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated MAPREDUCE-1385:
-----------------------------------
Attachment: mr-6299.patch
The patch for trunk
> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-1385
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.22.0
>
> Attachments: mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.