You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Srikanth Sundarrajan (JIRA)" <ji...@apache.org> on 2013/02/20 02:35:13 UTC

[jira] [Created] (MAPREDUCE-5014) Extending DistCp through a custom CopyListing is not possible

Srikanth Sundarrajan created MAPREDUCE-5014:
-----------------------------------------------

             Summary: Extending DistCp through a custom CopyListing is not possible
                 Key: MAPREDUCE-5014
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5014
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: distcp
    Affects Versions: 0.23.5, 0.23.4, 0.23.3, 0.23.1, 0.23.0, trunk
            Reporter: Srikanth Sundarrajan
            Assignee: Srikanth Sundarrajan


* While it is possible to implement a custom CopyListing in DistCp, DistCp driver class doesn't allow for using this custom CopyListing.

* Allow SimpleCopyListing to provide an option to exclude files (For instance it is useful to exclude FileOutputCommiter.SUCCEEDED_FILE_NAME during copy as premature copy can indicate that the entire data is available at the destination)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira