[jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

["Carlo Curino (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045429#comment-14045429 ] 

Carlo Curino commented on YARN-1711:
------------------------------------

Attached a patch that provide 2 simple policies for sharing resources. 
* The NoOverCommitPolicy simply enforce plan physical resource availability (as multiple agents from YARN-1710 could concurrently try to add to the plan).
* The CapacityOvertimePolicy is a natural exension of the notion of Capacity where each user is given a maximum instantaneous limit (e.g., 50% of the plan capacity in any instant in time), and a maximum integral limit (e.g., no more than 10% in average an any 24h period of time). Setting the 3 parameters of maxInstantaneous, maxAverage, and validationWindow, allows administrators to choose how flexible or strict is the sharing.... on one extreme the administrator can impose instantaneous limits equivalent to user-limit in a regular queue, and on the opposite it can allow users to grab large blocks of resources for large period of time (before having to yield to others).

As mentioned for other sub-tasks of YARN-1051 the patch is marked available to signal its availability for review, but not committable on its own.


> CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709
> --------------------------------------------------------------------------
>
>                 Key: YARN-1711
>                 URL: https://issues.apache.org/jira/browse/YARN-1711
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>              Labels: reservations
>         Attachments: YARN-1711.patch
>
>
> This JIRA tracks the development of a policy that enforces user quotas (a time-extension of the notion of capacity) in the inventory subsystem discussed in YARN-1709.



--
This message was sent by Atlassian JIRA
(v6.2#6252)