You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Carlo Curino (JIRA)" <ji...@apache.org> on 2015/11/17 00:58:10 UTC

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

    [ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007657#comment-15007657 ] 

Carlo Curino commented on YARN-4358:
------------------------------------

In this patch, we propose to change the relationship between ReservationAgent/Plan/SharingPolicy for two reasons:
 * agents ignore constraints that the SharingPolicy knows about (e.g., instantaneous max Resource)
 * agents repeatedly query the plan to obtain a view of resources (and remove the used from the total available)

We introduce a new API in the plan, that provides a compact RLESparseResourceAllocation based view of available resources.
Furhtermore, the InMemoryPlan interacts with the SharingPolicy to "customize" the view so that the agent only sees the resources
that are available for the given tenant at the given time. 

> Improve relationship between SharingPolicy and ReservationAgent
> ---------------------------------------------------------------
>
>                 Key: YARN-4358
>                 URL: https://issues.apache.org/jira/browse/YARN-4358
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler, fairscheduler, resourcemanager
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>
> At the moment an agent places based on available resources, but has no visibility to extra constraints imposed by the SharingPolicy. While not all constraints are easily represented some (e.g., max-instantaneous resources) are easily represented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)