You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Lantao Jin (JIRA)" <ji...@apache.org> on 2019/03/01 03:48:00 UTC

[jira] [Commented] (YARN-9332) RackResolver tool should accept multiple hosts

    [ https://issues.apache.org/jira/browse/YARN-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781253#comment-16781253 ] 

Lantao Jin commented on YARN-9332:
----------------------------------

Hi [~cheersyang], thanks for your review. New patch file attached.

> RackResolver tool should accept multiple hosts
> ----------------------------------------------
>
>                 Key: YARN-9332
>                 URL: https://issues.apache.org/jira/browse/YARN-9332
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 2.9.2, 3.0.3, 2.8.5, 2.7.7, 3.1.2
>            Reporter: Lantao Jin
>            Assignee: Lantao Jin
>            Priority: Minor
>         Attachments: YARN-9332.001.patch, YARN-9332.002.patch
>
>
> RackResolver as a public rack resolver tool only offers a method {{public static Node resolve(String hostName)}} which only accepts one host a time. Actually the internal implementation class {{DNSToSwitchMapping}} always accept a host list as its input and return a list of resolved racks. That's cause the invoker like Spark takes a long time to resolve the rack info when handling abundant tasks (a mass of loops to execute script to resolve rack info).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org