[jira] [Comment Edited] (YARN-9416) Add filter options to FS placement rules

["Wilfred Spiegelenburg (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802761#comment-16802761 ] 

Wilfred Spiegelenburg edited comment on YARN-9416 at 3/27/19 1:22 PM:
----------------------------------------------------------------------

The proposal is to add a new child entry to all rules, like the parent rule we have now.

Name of the xml node: 
* filter
Name of the attributes supported for each: 
* type (_allow_ or _deny_)
* users  (comma separated list)
* groups (comma separated _ordered_ list)

The type attribute is required. One of the users and groups attributes can be omitted or left empty. If both are left empty the filter is ignored.
The ordering only has an impact on the secondary group rule, and thus the group filter, in combination with the _allow_ type. That is the only rule that has a loop running over a number of values that are returned in a random order by the OS. The order in which the list is specified will be the order in which the secondary groups are evaluated in the rule.

When a rule has a filter set we check the filter before we decide if the queue found will be returned. This is independent of the ACLs.


was (Author: wilfreds):
The proposal is to add a new child entry to all rules, like the parent rule we have now.

Name of the xml node: 
* userfilter
* groupfilter
Name of the attributes supported for each: 
* type (order, allow or deny)
* members (comma separated ordered list)
When a rule has a filter set we check the filter before we decide if the queue found will be returned. This is independent of the ACLs.

> Add filter options to FS placement rules
> ----------------------------------------
>
>                 Key: YARN-9416
>                 URL: https://issues.apache.org/jira/browse/YARN-9416
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>    Affects Versions: 3.3.0
>            Reporter: Wilfred Spiegelenburg
>            Assignee: Wilfred Spiegelenburg
>            Priority: Major
>
> The placement rules should allow filtering of the groups and or users that match the rule.
> In the case of the user rule you might want it to only match if the users are member of a specific group. An other example would be to only allow specific users to match the specified rule.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org