You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Karthik Kambatla (JIRA)" <ji...@apache.org> on 2015/11/04 16:11:27 UTC

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

    [ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989664#comment-14989664 ] 

Karthik Kambatla commented on YARN-3980:
----------------------------------------

Thanks Inigo. Looks generally good. Comments:
# javadoc error in SchedulerNode
# Can we make the necessary changes on FairScheduler and FifoScheduler as well? It should be similar and straight-forward. 

Not sure if there is a simple way to test this. Can we leverage the SLS to verify the node utilization passed in the heartbeat shows up in the scheduler? If not, I am comfortable with checking this in without a test. 

> Plumb resource-utilization info in node heartbeat through to the scheduler
> --------------------------------------------------------------------------
>
>                 Key: YARN-3980
>                 URL: https://issues.apache.org/jira/browse/YARN-3980
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager, scheduler
>    Affects Versions: 2.7.1
>            Reporter: Karthik Kambatla
>            Assignee: Inigo Goiri
>         Attachments: YARN-3980-v0.patch, YARN-3980-v1.patch, YARN-3980-v2.patch, YARN-3980-v3.patch
>
>
> YARN-1012 and YARN-3534 collect resource utilization information for all containers and the node respectively and send it to the RM on node heartbeat. We should plumb it through to the scheduler so the scheduler can make use of it. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)