[jira] [Created] (HDFS-6491) proposal for developing a tool to compare files/dirs

["Yongjun Zhang (JIRA)" <ji...@apache.org>]

Yongjun Zhang created HDFS-6491:
-----------------------------------

             Summary: proposal for developing a tool to compare files/dirs
                 Key: HDFS-6491
                 URL: https://issues.apache.org/jira/browse/HDFS-6491
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: tools
    Affects Versions: 2.4.0
            Reporter: Yongjun Zhang
            Assignee: Yongjun Zhang


We have a tool distcp that copy files similar to unix/linux cp command but copy files in a distributed way, but we don't have a tool to compare files/dirs. I think to provide such a tool like this would be helpful.  We can name it distdiff to be consistent with distcp.
 
Right now I'm thinking about providing some basic functionality as a starting point, and we can add more features or add performance improvement later.

I had opportunity to discuss this with [~daryn] and [~szetszwo] in person. Thanks both of them a lot for the very valuable inputs.




--
This message was sent by Atlassian JIRA
(v6.2#6252)