[jira] [Moved] (YARN-9863) Randomize List of Resources to Localize

["David Mollitor (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Mollitor moved MAPREDUCE-7243 to YARN-9863:
-------------------------------------------------

    Component/s:     (was: performance)
                     (was: nodemanager)
                 nodemanager
            Key: YARN-9863  (was: MAPREDUCE-7243)
        Project: Hadoop YARN  (was: Hadoop Map/Reduce)

> Randomize List of Resources to Localize
> ---------------------------------------
>
>                 Key: YARN-9863
>                 URL: https://issues.apache.org/jira/browse/YARN-9863
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager
>            Reporter: David Mollitor
>            Assignee: David Mollitor
>            Priority: Minor
>
> https://github.com/apache/hadoop/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/LocalResourceBuilder.java
> Add a new parameter to {{LocalResourceBuilder}} that allows the list of resources to be shuffled randomly.  This will allow the Localizer to spread the load of requests so that not all of the NodeManagers are requesting to localize the same files, in the same order, from the same DataNodes,



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org