You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Manikandan R (JIRA)" <ji...@apache.org> on 2017/10/12 18:28:00 UTC

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

    [ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202394#comment-16202394 ] 

Manikandan R commented on YARN-7159:
------------------------------------

[~wangda] [~sunilg] Thanks for giving me an opportunity to contribute to this JIRA.

Had a offline discussion with [~sunilg] on the approaches. Attached a patch to convert resource value if its units is different from the corresponding resource units at RM side as part of resource object creation so that units conversions happening at several other places can be removed to improve performance.

> Normalize unit of resource objects in RM and avoid to do unit conversion in critical path
> -----------------------------------------------------------------------------------------
>
>                 Key: YARN-7159
>                 URL: https://issues.apache.org/jira/browse/YARN-7159
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Wangda Tan
>            Priority: Critical
>         Attachments: YARN-7159.001.patch
>
>
> Currently resource conversion could happen in critical code path when different unit is specified by client. This could impact performance and throughput of RM a lot. We should do unit normalization when resource passed to RM and avoid expensive unit conversion every time.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org