You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Inigo Goiri (JIRA)" <ji...@apache.org> on 2015/04/14 00:04:12 UTC

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

    [ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493172#comment-14493172 ] 

Inigo Goiri commented on YARN-3481:
-----------------------------------

To make YARN aware of the actual use of resources in the machines and not only allocation, the RM should track the actual utilization. Right now, the ContainerMonitor collects the CPU and the memory utilization for each container (YARN-3122 and YARN-2984). We want to collect this information in the NodeStatusUpdater and report it to the RM in the NodeStatus. This would add a Resource (availableResources) to the heartbeat.

Thoughts?

> Report NM aggregated container resource utilization in heartbeat
> ----------------------------------------------------------------
>
>                 Key: YARN-3481
>                 URL: https://issues.apache.org/jira/browse/YARN-3481
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Priority: Minor
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> To allow the RM take better scheduling decisions, it should be aware of the actual utilization of the containers. The NM would aggregate the ContainerMetrics and report it in every heartbeat.
> Related to YARN-1012 but aggregated to reduce the heartbeat overhead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)