[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

["Carlo Curino (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321562#comment-15321562 ] 

Carlo Curino commented on YARN-5215:
------------------------------------

Bar proper synching with YARN-1011 and YARN-5202 efforts and polishing the patch to include tests and conf switches, 
I am very supportive of this effort. It seems a rather simple change that can deal with a broad set of issues when YARN 
is not the only thing running on a set of machines.  The fact that you have been running this for a while is also reassuring. 
Were those prod clusters? Scale? 

Please provide a cleaned-up version of the patch, and comment on [~jlowe] comment.

[~jlowe] would you be ok with this going in? Can you build upon it for the work you are doing or is it horribly incompatible?  

> Scheduling containers based on external load in the servers
> -----------------------------------------------------------
>
>                 Key: YARN-5215
>                 URL: https://issues.apache.org/jira/browse/YARN-5215
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Inigo Goiri
>         Attachments: YARN-5215.000.patch
>
>
> Currently YARN runs containers in the servers assuming that they own all the resources. The proposal is to use the utilization information in the node and the containers to estimate how much is consumed by external processes and schedule based on this estimation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org