You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by lk_hadoop <lk...@163.com> on 2016/10/20 09:46:21 UTC

DistCp cp ftp folder to hdfs

hi,all:
I want to cp data files under a folder from ftp server to hdfs:
hadoop distcp ftp://youftp:youftp@192.168.0.232/biz/*.zip hdfs://dev0:9000/sourcedata/biz/
but the progress was hung :
16/10/20 17:36:45 INFO tools.DistCp: Input Options: DistCpOptions{atomicCommit=false, syncFolder=false, deleteMissing=false, ignoreFailures=false, maxMaps=20, sslConfigurationFile='null', copyStrategy='uniformsize', sourceFileListing=null, sourcePaths=[ftp://youftp:youftp@192.168.0.232/biz/*.zip], targetPath=hdfs://dev0:9000/sourcedata/biz/, targetPathExists=false, preserveRawXattrs=false}
16/10/20 17:36:45 INFO client.RMProxy: Connecting to ResourceManager at dev0.youdata.com/192.168.0.130:8032

but ,if I give a specific filename ,for example :abc.zip ,it works. I don't know what to do .


2016-10-20


lk_hadoop