You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Ishai Menache (JIRA)" <ji...@apache.org> on 2015/05/16 01:24:01 UTC

[jira] [Updated] (YARN-3656) LowCost: A Cost-Based Placement Agent for YARN Reservations

     [ https://issues.apache.org/jira/browse/YARN-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ishai Menache updated YARN-3656:
--------------------------------
    Attachment: LowCostRayonExternal.pdf

This tech-report summarizes the details of LowCost, as well as our experimental results which show benefits in using LowCost on a variety of performance metrics

> LowCost: A Cost-Based Placement Agent for YARN Reservations
> -----------------------------------------------------------
>
>                 Key: YARN-3656
>                 URL: https://issues.apache.org/jira/browse/YARN-3656
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler, resourcemanager
>            Reporter: Ishai Menache
>         Attachments: LowCostRayonExternal.pdf
>
>
> YARN-1051 enables SLA support by allowing users to reserve cluster capacity ahead of time. YARN-1710 introduced a greedy agent for placing user reservations. The greedy agent makes fast placement decisions but at the cost of ignoring the cluster committed resources, which might result in blocking the cluster resources for certain periods of time, and in turn rejecting some arriving jobs.
> We propose LowCost – a new cost-based planning algorithm. LowCost “spreads” the demand of the job throughout the allowed time-window according to a global, load-based cost function. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)