You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj Das (JIRA)" <ji...@apache.org> on 2010/01/18 19:50:54 UTC

[jira] Created: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
-----------------------------------------------------------------------------

                 Key: MAPREDUCE-1385
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
            Reporter: Devaraj Das
            Assignee: Devaraj Das
             Fix For: 0.22.0


This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806694#action_12806694 ] 

Hudson commented on MAPREDUCE-1385:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #221 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/221/])
    

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated MAPREDUCE-1385:
-----------------------------------

    Attachment: mr-6299.8.patch

Tests pass with this patch.

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841431#action_12841431 ] 

Hudson commented on MAPREDUCE-1385:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #248 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/248/])
    

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805402#action_12805402 ] 

Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------

+1


> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804812#action_12804812 ] 

Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------

The following code from Cluster.java and ClusterWithLinuxTaskController is a no-op:

{noformat}
UserGroupInformation.getCurrentUser().doAs(...)
{noformat}

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804754#action_12804754 ] 

Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------

Please use the long form of the user name rather than the short form in spots like:

{noformat}
-    JobInfo jobInfo = new JobInfo(jobId, new Text(ugi.getUserName()), 
+    JobInfo jobInfo = new JobInfo(jobId, new Text(ugi.getShortUserName()), 
{noformat}

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12804746#action_12804746 ] 

Owen O'Malley commented on MAPREDUCE-1385:
------------------------------------------

Please add a call to UserGroupInformation.setConfiguration at the start of the JobTracker, and TaskTracker so that UGI uses the same configuration object. The Task should also use setConfiguration with the job's configuration.

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828466#action_12828466 ] 

Hudson commented on MAPREDUCE-1385:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #225 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/225/])
    

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated MAPREDUCE-1385:
-----------------------------------

    Attachment: mr-6299.3.patch

The earlier patch went out of sync. Updated patch.

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved MAPREDUCE-1385.
--------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Incompatible change, Reviewed]

I just committed this. Thanks, Devaraj!

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840519#action_12840519 ] 

Hudson commented on MAPREDUCE-1385:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #255 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/255/])
    MAPREDUCE-1421. LinuxTaskController tests failing on trunk after the commit of . Contributed by Amareshwari Sriramadasu.


> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805342#action_12805342 ] 

Devaraj Das commented on MAPREDUCE-1385:
----------------------------------------

Ok i could run findbugs on this patch and confirmed that it doesn't add any new warnings. I also ran javadoc and javac-warnings ones. No new warnings there too. I am sure I didn't introduce any new release audit warnings since there are no new files in the patch. Same for @author tags. It is almost impossible to run the stand-alone test-patch command, as it exists today, on this patch. 

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.8.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated MAPREDUCE-1385:
-----------------------------------

    Attachment: mr-6299.7.patch

Patch that addresses Owen's concerns. Running tests now. Running test-patch proved to be a real pain. Still trying to run it..

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.3.patch, mr-6299.7.patch, mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1385) Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj Das updated MAPREDUCE-1385:
-----------------------------------

    Attachment: mr-6299.patch

The patch for trunk

> Make changes to MapReduce for the new UserGroupInformation APIs (HADOOP-6299)
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1385
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1385
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Devaraj Das
>            Assignee: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: mr-6299.patch
>
>
> This is about moving the MapReduce code to use the new UserGroupInformation API as described in HADOOP-6299.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.