You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ramesh B (Jira)" <ji...@apache.org> on 2020/08/18 05:35:00 UTC
[jira] [Commented] (MAPREDUCE-6734) Add option to distcp to
preserve file path structure of source files at the destination
[ https://issues.apache.org/jira/browse/MAPREDUCE-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17179366#comment-17179366 ]
Ramesh B commented on MAPREDUCE-6734:
-------------------------------------
Any update on this.? This is very helpful where you just want to copy list of directories with different origin to destination. And what does the targetPath do after this change, Is it just a filesystem scheme?
> Add option to distcp to preserve file path structure of source files at the destination
> ---------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6734
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6734
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: distcp
> Affects Versions: 3.0.0-alpha2
> Environment: Software platform
> Reporter: Frederick Tucker
> Priority: Major
> Labels: distcp, newbie, patch
> Attachments: MAPREDUCE-6734.3.0.0-alpha2.patch, MAPREDUCE-6734.3.0.0-alpha2.patch
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When copying files using distcp with globbed source files, all the matched files in the glob are copied in a single flat directory. This causes problems when the file structure at the source is important. It also is an issue when there are two files matched in the glob with the same name because it causes a duplicate file error at the target. I'd like to have an option to preserve the file structure of the source files when globbing inputs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org