You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Mag Gam <ma...@gmail.com> on 2011/01/12 03:32:48 UTC

rsync + hdfs

Is there a tool similar to rsync for hdfs? I would like to check for:
ctime and size (the default behavior of rsync) and then sync if
necessary. This would be a nice feature to add in the dfs utilities.

Re: rsync + hdfs

Posted by Allen Wittenauer <aw...@linkedin.com>.

On Jan 11, 2011, at 6:32 PM, Mag Gam wrote:

> Is there a tool similar to rsync for hdfs? I would like to check for:
> ctime and size (the default behavior of rsync) and then sync if
> necessary. This would be a nice feature to add in the dfs utilities.


distcp is the closest.