You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Robert Kanter (JIRA)" <ji...@apache.org> on 2015/07/01 01:55:05 UTC

[jira] [Resolved] (MAPREDUCE-6121) JobResourceUpdater#compareFs() doesn't handle HA namespaces

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Kanter resolved MAPREDUCE-6121.
--------------------------------------
       Resolution: Fixed
     Hadoop Flags: Reviewed
    Fix Version/s: 2.8.0

Thanks Ray.  Committed to trunk and branch-2!

> JobResourceUpdater#compareFs() doesn't handle HA namespaces
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-6121
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.5.0
>            Reporter: Thomas Graves
>            Assignee: Ray Chiang
>             Fix For: 2.8.0
>
>         Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch, MAPREDUCE-6121.003.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces.  The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces this is going to fail and its going to copy the file when it doesn't need to. 
> Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)