You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Karthik Kambatla (JIRA)" <ji...@apache.org> on 2015/04/30 19:43:08 UTC

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

    [ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521926#comment-14521926 ] 

Karthik Kambatla commented on YARN-3332:
----------------------------------------

[~vinodkv] - did you start implementing this? I would like to be involved in the work here - either implementing parts of it or reviewing most of it. 

> [Umbrella] Unified Resource Statistics Collection per node
> ----------------------------------------------------------
>
>                 Key: YARN-3332
>                 URL: https://issues.apache.org/jira/browse/YARN-3332
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>         Attachments: Design - UnifiedResourceStatisticsCollection.pdf
>
>
> Today in YARN, NodeManager collects statistics like per container resource usage and overall physical resources available on the machine. Currently this is used internally in YARN by the NodeManager for only a limited usage: automatically determining the capacity of resources on node and enforcing memory usage to what is reserved per container.
> This proposal is to extend the existing architecture and collect statistics for usage b​eyond​ the existing use­cases.
> Proposal attached in comments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)