You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Tianying Chang (JIRA)" <ji...@apache.org> on 2014/05/12 22:17:16 UTC

[jira] [Commented] (MAPREDUCE-5081) Backport DistCpV2 and the related JIRAs to branch-1

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995579#comment-13995579 ] 

Tianying Chang commented on MAPREDUCE-5081:
-------------------------------------------

[~szetszwo] is this distcpV2 available if I am using hdfs2 with Mapreduce1? It seems it has a API break change on this API:  org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(Lorg/apache/hadoop/mapreduce/Cluster;Lorg/apache/hadoop/conf/Configuration;)    BTW, we are using Hadoop 2.0.0-cdh4.2.0 



> Backport DistCpV2 and the related JIRAs to branch-1
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-5081
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5081
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>             Fix For: 1.2.0
>
>         Attachments: DistCp.java.diff, m5081_20130328.patch, m5081_20130328b.patch, m5981_20130321.patch, m5981_20130321b.patch, m5981_20130323.patch
>
>
> Here is a list of DistCpV2 JIRAs:
> - MAPREDUCE-2765: DistCpV2 main jira
> - HADOOP-8703: turn CRC checking off for 0 byte size 
> - HDFS-3054: distcp -skipcrccheck has no effect.
> - HADOOP-8431: Running distcp without args throws IllegalArgumentException
> - HADOOP-8775: non-positive value to -bandwidth
> - MAPREDUCE-4654: TestDistCp is ignored
> - HADOOP-9022: distcp fails to copy file if -m 0 specified
> - HADOOP-9025: TestCopyListing failing
> - MAPREDUCE-5075: DistCp leaks input file handles
> - distcp part of HADOOP-8341: Fix findbugs issues in hadoop-tools
> - MAPREDUCE-5014: custom CopyListing



--
This message was sent by Atlassian JIRA
(v6.2#6252)