You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Andrew Noel (JIRA)" <ji...@apache.org> on 2013/04/05 18:09:17 UTC

[jira] [Commented] (MAPREDUCE-5132) Enhance FairScheduler queue selection with Unix-SubGroups

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13623753#comment-13623753 ] 

Andrew Noel commented on MAPREDUCE-5132:
----------------------------------------

Ted provided the java code to my organization out of a request to have a method of better managing the user community workload. This has been huge in governing the workload and taking the pool decision out of the inexperienced user hands and into the hands of the administrators. It allows for a much more granular control. 
                
> Enhance FairScheduler queue selection with Unix-SubGroups
> ---------------------------------------------------------
>
>                 Key: MAPREDUCE-5132
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5132
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Ted Malaska
>            Priority: Minor
>         Attachments: FairSchedulerPlusCode.zip
>
>
> I have clients that use the primary group for other reasons and would like to select the fairScheduler queue by subgroup.
> Currently the fairscheduler can only link a job config property to a fairscheduler queue and subgroups are not in the job config.  
> Now thankfully we can get this data from UserGroupInformation.createProxyUser which is cool because this is how TT currently see if it can copy data when kerberos is enabled.  Once we have the sub-groups we just connect the first sub-group that matches a queue.
> I'll put up some code that I used to solve the problem in the short term.  
> Note that there is an issue with this code.  It doesn't populate the TT Web UI drop down menu correctly.  I think I have a solution for that, but before I implement that I was wondering if the community has any feedback first.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira