You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jiahongchao (Jira)" <ji...@apache.org> on 2021/11/03 01:25:00 UTC
[jira] [Updated] (HADOOP-17933) Document of "DistCp Guide" is wrong
[ https://issues.apache.org/jira/browse/HADOOP-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiahongchao updated HADOOP-17933:
---------------------------------
Description:
In [https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html] [,|https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html,] it says
{quote}Now, consider the following copy operation:
distcp hdfs://nn1:8020/source/first hdfs://nn1:8020/source/second hdfs://nn2:8020/target
With sources/sizes:
hdfs://nn1:8020/source/first/1 32
hdfs://nn1:8020/source/first/2 32
hdfs://nn1:8020/source/second/10 64
hdfs://nn1:8020/source/second/20 32
And destination/sizes:
hdfs://nn2:8020/target/1 32
hdfs://nn2:8020/target/10 32
hdfs://nn2:8020/target/20 64
Will effect:
hdfs://nn2:8020/target/1 32
hdfs://nn2:8020/target/2 32
hdfs://nn2:8020/target/10 64
hdfs://nn2:8020/target/20 32
{quote}
However, since neither _{{-update}}_ or _-overwrite_ is used, _*first*_ and _*second*_ directories will be created
was:
In [https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html,] it says
{quote}Now, consider the following copy operation:
distcp hdfs://nn1:8020/source/first hdfs://nn1:8020/source/second hdfs://nn2:8020/target
With sources/sizes:
hdfs://nn1:8020/source/first/1 32
hdfs://nn1:8020/source/first/2 32
hdfs://nn1:8020/source/second/10 64
hdfs://nn1:8020/source/second/20 32
And destination/sizes:
hdfs://nn2:8020/target/1 32
hdfs://nn2:8020/target/10 32
hdfs://nn2:8020/target/20 64
Will effect:
hdfs://nn2:8020/target/1 32
hdfs://nn2:8020/target/2 32
hdfs://nn2:8020/target/10 64
hdfs://nn2:8020/target/20 32
{quote}
However, since neither _{{-update}}_ or _-overwrite_ is used, _*first*_ and _*second*_ directories will be created
> Document of "DistCp Guide" is wrong
> -----------------------------------
>
> Key: HADOOP-17933
> URL: https://issues.apache.org/jira/browse/HADOOP-17933
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation, tools/distcp
> Reporter: Jiahongchao
> Priority: Minor
>
> In [https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html] [,|https://hadoop.apache.org/docs/stable/hadoop-distcp/DistCp.html,] it says
> {quote}Now, consider the following copy operation:
> distcp hdfs://nn1:8020/source/first hdfs://nn1:8020/source/second hdfs://nn2:8020/target
> With sources/sizes:
> hdfs://nn1:8020/source/first/1 32
> hdfs://nn1:8020/source/first/2 32
> hdfs://nn1:8020/source/second/10 64
> hdfs://nn1:8020/source/second/20 32
> And destination/sizes:
> hdfs://nn2:8020/target/1 32
> hdfs://nn2:8020/target/10 32
> hdfs://nn2:8020/target/20 64
> Will effect:
> hdfs://nn2:8020/target/1 32
> hdfs://nn2:8020/target/2 32
> hdfs://nn2:8020/target/10 64
> hdfs://nn2:8020/target/20 32
> {quote}
> However, since neither _{{-update}}_ or _-overwrite_ is used, _*first*_ and _*second*_ directories will be created
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org