You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by Jerry Zhao <zh...@126.com> on 2021/06/03 11:55:23 UTC

FTPFileSystem can't rename files in different directory

HI, 
I have a confusion about the reason of FTPFilesystem only support same directory rename, distCp that from other filesystem copying files to ftp filesystem can’t work well, because the distCp write temp files in a temp path, then rename files to different directory. I would like to update the logic, Can I do this?

Re: FTPFileSystem can't rename files in different directory

Posted by Steve Loughran <st...@cloudera.com.INVALID>.

I've seen the JIRA

Can you just use -direct and so skip renames entirely? It's written for
stores (S3, openstack) where renaming is so slow it kills performance, but
it should work here too

On Thu, 3 Jun 2021 at 12:55, Jerry Zhao <zh...@126.com> wrote:

> HI,
> I have a confusion about the reason of FTPFilesystem only support same
> directory rename, distCp that from other filesystem copying files to ftp
> filesystem can’t work well, because the distCp write temp files in a temp
> path, then rename files to different directory. I would like to update the
> logic, Can I do this?
>
>
>
>
>
>
>
>