You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Siqi Li (JIRA)" <ji...@apache.org> on 2014/10/02 01:19:34 UTC

[jira] [Resolved] (MAPREDUCE-6047) Introduce localization phase for mapreduce jobs

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siqi Li resolved MAPREDUCE-6047.
--------------------------------
    Resolution: Duplicate

> Introduce localization phase for mapreduce jobs
> -----------------------------------------------
>
>                 Key: MAPREDUCE-6047
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6047
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Siqi Li
>            Assignee: Siqi Li
>
> we have been experienced lots of task timeout due to localization of a large number of files. It would be great if we have an additional phase that keep track of how many files have been localized. Thus for Mappers we had "localization", "map", "sort". For backwards compatibility, we can keep it 0% but still heartbeat to AM with the status string "5/300 files localized".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)