You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Ray Chiang (JIRA)" <ji...@apache.org> on 2015/06/22 23:37:03 UTC

[jira] [Updated] (MAPREDUCE-6121) JobSubmitter.compareFs doesn't handle HA namespaces

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ray Chiang updated MAPREDUCE-6121:
----------------------------------
    Attachment: MAPREDUCE-6121.001.patch

- Merge JobResourceUpdater#compareFs() and DistCpUtils#compareFs() into single static method definition in FileUtil
- Fix calls to compareFs to point to the FileUtil version
- Update version to compare srcHost and dstHost before calling InetAddress#getCanonicalHostName() to support HA-based strings

> JobSubmitter.compareFs doesn't handle HA namespaces
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-6121
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.5.0
>            Reporter: Thomas Graves
>            Assignee: Ray Chiang
>         Attachments: MAPREDUCE-6121.001.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces.  The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces this is going to fail and its going to copy the file when it doesn't need to. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)