[jira] [Commented] (HADOOP-15892) hadoop distcp command fail without reminder

["Steve Loughran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674504#comment-16674504 ] 

Steve Loughran commented on HADOOP-15892:
-----------------------------------------

I guess the issue here is that the trailing / is what's causing problems. I suspect that distcp isn't looking for that and just says "path doesn't exist", and with the source being a file, it assumes the destination is the file. 

I understand, but I don't think we can do anything about it, even if it seems the wrong thing. There's a risk that people have come to expect it, and the risk that anything which is done is going to break things. Distcp is a piece of code which is used in so many workflows that we are scare of touching it.

Sorry, but while I recognise your unhappiness, I'm going to close as a "wontfix"

>  hadoop distcp command fail without reminder
> --------------------------------------------
>
>                 Key: HADOOP-15892
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15892
>             Project: Hadoop Common
>          Issue Type: Wish
>          Components: fs
>    Affects Versions: 2.5.0
>            Reporter: Chang Zhichao
>            Priority: Minor
>
> I am try using hadoop distcp command to copy a file (000079_0) to a directory (target_directory/part_date=2018-10-28/), and the directory is not exist, like this
> {code:java}
> $ hadoop fs -ls /user/hive/warehouse/migration_chang.db/target_directory/
> $
> $ hadoop distcp hdfs://sdg/user/hive/warehouse/migration_chang.db/source_directory/part_date=2018-10-28/000079_0   hdfs://sdg/user/hive/warehouse/migration_chang.db/target_directory/part_date=2018-10-28/
> {code}
> It will copy the source file '000079_0' to a file called "part_date=2018-10-28".
> {code:java}
> $ hadoop fs -ls /user/hive/warehouse/migration_chang.db/target_directory/
> Found 1 items
> -rw-r--r-- 3 hadoop supergroup 353024605 2018-10-31 19:51 /user/hive/warehouse/migration_chang.db/snda_game_user_profile_mid_5/part_date=2018-10-28{code}
> I think it is confusing, and better way is remind error like " No such directory" .('hadoop fs -cp' command or Linux 'cp' command do like this way.)
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org