[jira] [Created] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

["Yongjun Zhang (JIRA)" <ji...@apache.org>]

Yongjun Zhang created HDFS-10314:
------------------------------------

             Summary: Propose a new tool that wraps around distcp to "restore" changes on target cluster
                 Key: HDFS-10314
                 URL: https://issues.apache.org/jira/browse/HDFS-10314
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: tools
            Reporter: Yongjun Zhang
            Assignee: Yongjun Zhang


HDFS-9820 proposed adding -rdiff switch to distcp, as a reversed operation of -diff switch. 

Upon discussion with [~jingzhao], we will introduce a new tool that wraps around distcp to achieve the same purpose.

I'm thinking about calling the new tool "rsync", similar to unix/linux command "rsync". The "r" here means remote.

The syntax that simulate -rdiff behavior proposed in HDFS-9820 is
 {code}  
    rsync <fromSnapshotName>  <toSnapshotName>  <source> <target>
Pcode}
This command ensure <fromSnapshotName>  is newer than <toSnapshotName>.

I think, In the future, we can add another command to have the functionality of -diff switch of distcp.
 {code}  
    sync <fromSnapshotName>  <toSnapshotName>  <source> <target>
Pcode}
where <fromSnapshotName>  must be older than <toSnapshotName>.

Thanks [~jingzhao].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)