You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Matei Zaharia (JIRA)" <ji...@apache.org> on 2011/05/17 22:19:47 UTC
[jira] [Created] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Explain how to use ACLs in the fair scheduler
---------------------------------------------
Key: MAPREDUCE-2505
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: contrib/fair-share, documentation
Affects Versions: 0.21.0, 0.20.2, 0.20.203.0
Reporter: Matei Zaharia
Assignee: Matei Zaharia
Priority: Minor
The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matei Zaharia updated MAPREDUCE-2505:
-------------------------------------
Status: Patch Available (was: Open)
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.21.0, 0.20.2, 0.20.203.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035986#comment-13035986 ]
Matei Zaharia commented on MAPREDUCE-2505:
------------------------------------------
Thanks for committing this, Eli. I'm going to commit it to the 0.20 and 0.21 branches as well, with a minor modification (the queue name property is called something different in 0.20).
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matei Zaharia updated MAPREDUCE-2505:
-------------------------------------
Attachment: MAPREDUCE-2505.patch
Here's a patch to add this documentation.
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matei Zaharia updated MAPREDUCE-2505:
-------------------------------------
Attachment: MAPREDUCE-2505-branch-0.20-security.patch
Here's a patch for 0.20.203, but I'm a bit confused about where the work is being done for the next release. Should I put this in the 0.20-security branch, or 0.20.203, or 0.20.204?
BTW I've decided to only commit this to the security branches because a) few people are likely to use new releases of 0.20.x and 0.21 and b) the security branches actually have security for the ACLs.
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505-branch-0.20-security.patch, MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035590#comment-13035590 ]
Hudson commented on MAPREDUCE-2505:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #681 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/681/])
MAPREDUCE-2505. Explain how to use ACLs in the fair scheduler. Contributed by Matei Zaharia.
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1124374
Files :
* /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml
* /hadoop/mapreduce/trunk/CHANGES.txt
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035951#comment-13035951 ]
Hudson commented on MAPREDUCE-2505:
-----------------------------------
Integrated in Hadoop-Mapreduce-22-branch #54 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-22-branch/54/])
MAPREDUCE-2505. svn merge -c 1124374 from trunk
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1124377
Files :
* /hadoop/mapreduce/branches/branch-0.22/conf
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/data_join
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/hdfs
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/ipc
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/streaming
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/build-contrib.xml
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/capacity-scheduler
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/fs
* /hadoop/mapreduce/branches/branch-0.22/src/docs/src/documentation/content/xdocs/fair_scheduler.xml
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/mrunit
* /hadoop/mapreduce/branches/branch-0.22/CHANGES.txt
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/block_forensics
* /hadoop/mapreduce/branches/branch-0.22/conf/capacity-scheduler.xml.template
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/io/TestSequenceFileMergeProgress.java
* /hadoop/mapreduce/branches/branch-0.22/src/java
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred
* /hadoop/mapreduce/branches/branch-0.22/src/webapps/job
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/vaidya
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/io/FileBench.java
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/dynamic-scheduler
* /hadoop/mapreduce/branches/branch-0.22/src/contrib
* /hadoop/mapreduce/branches/branch-0.22/src/examples
* /hadoop/mapreduce/branches/branch-0.22
* /hadoop/mapreduce/branches/branch-0.22/.gitignore
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/index
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/security/authorize/TestServiceLevelAuthorization.java
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/eclipse-plugin
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/build.xml
* /hadoop/mapreduce/branches/branch-0.22/src/contrib/fairscheduler
* /hadoop/mapreduce/branches/branch-0.22/src/c++
* /hadoop/mapreduce/branches/branch-0.22/src/test/mapred/org/apache/hadoop/test/MapredTestDriver.java
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035550#comment-13035550 ]
Eli Collins commented on MAPREDUCE-2505:
----------------------------------------
+1 lgtm
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036036#comment-13036036 ]
Eli Collins commented on MAPREDUCE-2505:
----------------------------------------
My pleasure. Should be {{mapred.job.queue.name}} in branch 20.
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035146#comment-13035146 ]
Hadoop QA commented on MAPREDUCE-2505:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12479517/MAPREDUCE-2505.patch
against trunk revision 1103993.
+1 @author. The patch does not contain any @author tags.
+0 tests included. The patch appears to be a documentation patch that doesn't require tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/261//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/261//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/261//console
This message is automatically generated.
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated MAPREDUCE-2505:
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.22.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I've committed this to branch 22 and trunk. Thanks Matei!
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matei Zaharia updated MAPREDUCE-2505:
-------------------------------------
Affects Version/s: 0.22.0
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2505) Explain how to use ACLs in the
fair scheduler
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036261#comment-13036261 ]
Hudson commented on MAPREDUCE-2505:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #684 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk/684/])
MAPREDUCE-2505. Explain how to use ACLs in the fair scheduler. Contributed by Matei Zaharia.
eli : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1124374
Files :
* /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml
* /hadoop/mapreduce/trunk/CHANGES.txt
> Explain how to use ACLs in the fair scheduler
> ---------------------------------------------
>
> Key: MAPREDUCE-2505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2505
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share, documentation
> Affects Versions: 0.20.2, 0.20.203.0, 0.21.0, 0.22.0
> Reporter: Matei Zaharia
> Assignee: Matei Zaharia
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-2505.patch
>
>
> The fair scheduler already works with the ACL system introduced through the mapred.queue.* parameters, but the documentation doesn't explain how to use this. We should add a paragraph or two about it.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira