You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Kuhu Shukla (JIRA)" <ji...@apache.org> on 2015/10/02 21:25:28 UTC
[jira] [Updated] (MAPREDUCE-6451) DistCp has incorrect
chunkFilePath for multiple jobs when strategy is dynamic
[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kuhu Shukla updated MAPREDUCE-6451:
-----------------------------------
Attachment: MAPREDUCE-6451-v4.patch
Thank you [~eepayne] for your review comments. Updated the patch. For the checkstyle issue of missing package-info.java , the file was not there for mapred/lib directory before and therefore I did not add one now. There is one for tools package already. I was referring the wrong .class for the new file, corrected that now. Request for review.
> DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic
> -----------------------------------------------------------------------------
>
> Key: MAPREDUCE-6451
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6451
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 2.6.0
> Reporter: Kuhu Shukla
> Assignee: Kuhu Shukla
> Attachments: MAPREDUCE-6451-v1.patch, MAPREDUCE-6451-v2.patch, MAPREDUCE-6451-v3.patch, MAPREDUCE-6451-v4.patch
>
>
> DistCp when used with dynamic strategy does not update the chunkFilePath and other static variables any time other than for the first job. This is seen when DistCp::run() is used.
> A single copy succeeds but multiple jobs finish successfully without any real copying.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)