You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Created) (JIRA)" <ji...@apache.org> on 2012/02/23 18:28:48 UTC

[jira] [Created] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

no admin override to view jobs on mr app master and job history server
----------------------------------------------------------------------

                 Key: MAPREDUCE-3903
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2
            Reporter: Thomas Graves
            Priority: Critical
             Fix For: 0.23.0


in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3903:
-------------------------------------

    Attachment: MAPREDUCE-3903.patch

added more unit tests.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219539#comment-13219539 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1813 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1813/])
    MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) (Revision 1295262)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295262
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3903:
-------------------------------------

    Attachment: MAPREDUCE-3903.patch
    
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219537#comment-13219537 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #611 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/611/])
    merge MAPREDUCE-3903 from trunk (Revision 1295263)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295263
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220001#comment-13220001 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #971 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/971/])
    MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) (Revision 1295262)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295262
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves reassigned MAPREDUCE-3903:
----------------------------------------

    Assignee: Thomas Graves
    
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217690#comment-13217690 ] 

Thomas Graves commented on MAPREDUCE-3903:
------------------------------------------

Ok, so it looks like there are a few bugs in the code.  Here is basically what I am planning implementing:

- yarn acls/application acls are separate from mapreduce acls.  They only control what a user can view/modify on the RM.  This include the admins as well. So yarn.admins do not apply to AM/history server.  

- mapreduce job acls are put into application acls when application is submitted (this didn't change)

- the mapreduce application master and mapreduce job history server purely use the mapreduce job acls - this includes mapreduce.cluster.acls.enabled, mapreduce.cluster.administrators, acl-view-job, and acl-modify-job.

This separates out yarn from mapreduce so that someone could be admin for mapreduce without being yarn admin and when other apps are ported to yarn, they can be separate too.  The reason I don't have yarn admins apply to job history server is because the job history server is a mapreduce only component and shouldn't be looking at the yarn configs.

The only problem with this still is it appears the AM and job history server are using the job configuration so the user can override the settings - this is bad!! I need to investigate that more.


                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Siddharth Seth (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219528#comment-13219528 ] 

Siddharth Seth commented on MAPREDUCE-3903:
-------------------------------------------

Thanks Thomas. +1, this looks good.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218760#comment-13218760 ] 

Hadoop QA commented on MAPREDUCE-3903:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516464/MAPREDUCE-3903.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1957//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1957//console

This message is automatically generated.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219542#comment-13219542 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1888 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1888/])
    MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) (Revision 1295262)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295262
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219589#comment-13219589 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #621 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/621/])
    merge MAPREDUCE-3903 from trunk (Revision 1295263)

     Result = ABORTED
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295263
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3903:
-------------------------------------

    Attachment: MAPREDUCE-3903.patch

updates from review.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Siddharth Seth (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218852#comment-13218852 ] 

Siddharth Seth commented on MAPREDUCE-3903:
-------------------------------------------

Looked at the patch. Looks good. One minor nit - the debug log should be within an if debug enabled check.
Not necessarily related to this patch - yarn has ACLs enabled by default, MR has them disabled by default. That can lead to strange behavior considering some of the calls like killJob use Yarn ACLs, while getJobStatus will use MR ACLs. The Yarn ACLs could be disabled by default as well.

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220049#comment-13220049 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #1006 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1006/])
    MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) (Revision 1295262)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295262
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth updated MAPREDUCE-3903:
--------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.23.2
     Hadoop Flags: Reviewed
           Status: Resolved  (was: Patch Available)

Committed to trunk, branch-0.23 and branch-0.23.2
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219330#comment-13219330 ] 

Hadoop QA commented on MAPREDUCE-3903:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516572/MAPREDUCE-3903.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1968//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1968//console

This message is automatically generated.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3903:
-------------------------------------

    Affects Version/s: 0.23.2
        Fix Version/s:     (was: 0.23.0)
    
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217360#comment-13217360 ] 

Thomas Graves commented on MAPREDUCE-3903:
------------------------------------------

So it actually appears we are inconsistent about acls.  If you are going through the web ui for AM or historyserver you get one behavior where it only checks the job acls, but if you go through the mapred cli which goes through the RM, it uses yarn acls and application acls. The application acls include the job acls.  Note that when going through the RM it doesn't seem to look at mapreduce.cluster.acls.enabled at all even through it appends the job acls to application acls.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218599#comment-13218599 ] 

Thomas Graves commented on MAPREDUCE-3903:
------------------------------------------

I was unable to get rid of the inconsistencies without major rework.  I have put the mapreduce.cluster.admins back in for the AM and job history web services. the cli will still use the yarn acls.  I also fixed a bug in the history server checkAccess routine where it was first checking to see if security was on.


                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219243#comment-13219243 ] 

Thomas Graves commented on MAPREDUCE-3903:
------------------------------------------

Thanks for the review Sid.  I'll update the patch with the debug call changed. I will also go ahead and turn the yarn acls off by default to so they match mapred settings.

All the cli commands should be consistent - they all use the yarn acls. They all go through the invoke->getProxy() path which gets an application report, which does the yarn acl checks. 

But yes if yarn acls are on and mapred acls are off, it will still check yarn acls and enforce them when viewing/killing a mapred job via the cli, but if you go through the web apps it won't check acls because it only uses the mapred acls.



                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219544#comment-13219544 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #622 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/622/])
    merge MAPREDUCE-3903 from trunk (Revision 1295263)

     Result = SUCCESS
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295263
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Graves updated MAPREDUCE-3903:
-------------------------------------

    Status: Patch Available  (was: Open)
    
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215924#comment-13215924 ] 

Thomas Graves commented on MAPREDUCE-3903:
------------------------------------------

As of right now it seems that the acls are disjoint between mapreduce and yarn.  Meaning turning on the yarn.acl.enable has no affect on the mapreduce history server or application master and turning on the mapreduce.cluster.acls.enabled has no affect on RM and NM.  So following that model I am going to have mapreduce.cluster.administrators control the admin rather then just using yarn.admin.acl.
                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3903) no admin override to view jobs on mr app master and job history server

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219590#comment-13219590 ] 

Hudson commented on MAPREDUCE-3903:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1819 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1819/])
    MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves) (Revision 1295262)

     Result = ABORTED
sseth : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1295262
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/JobACLsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobAclsManager.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/HistoryClientService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm

                
> no admin override to view jobs on mr app master and job history server
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3903
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3903
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3903.patch, MAPREDUCE-3903.patch, MAPREDUCE-3903.patch
>
>
> in 1.0 there was a config mapreduce.cluster.administrators that allowed administrators to view anyones job.  That no longer works on yarn.
> yarn has the new config yarn.admin.acl but it appears the mr app master and job history server don't use that.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira