You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Kuhu Shukla (JIRA)" <ji...@apache.org> on 2015/10/02 21:25:28 UTC

[jira] [Updated] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kuhu Shukla updated MAPREDUCE-6451:
-----------------------------------
    Attachment: MAPREDUCE-6451-v4.patch

Thank you [~eepayne] for your review comments. Updated the patch. For the checkstyle issue of missing package-info.java , the file was not there for mapred/lib directory before and therefore I did not add one now. There is one for tools package already. I was referring the wrong .class  for the new file, corrected that now. Request for review.

> DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6451
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6451
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 2.6.0
>            Reporter: Kuhu Shukla
>            Assignee: Kuhu Shukla
>         Attachments: MAPREDUCE-6451-v1.patch, MAPREDUCE-6451-v2.patch, MAPREDUCE-6451-v3.patch, MAPREDUCE-6451-v4.patch
>
>
> DistCp when used with dynamic strategy does not update the chunkFilePath and other static variables any time other than for the first job. This is seen when DistCp::run() is used. 
> A single copy succeeds but multiple jobs finish successfully without any real copying. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)