You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2013/02/23 03:26:12 UTC

[jira] [Updated] (HDFS-4523) Fix concat for snapshots

     [ https://issues.apache.org/jira/browse/HDFS-4523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HDFS-4523:
-----------------------------------------

    Attachment: h4523_20130222.patch

h4523_20130222.patch: fix concat and a bug in INodeFile replacement. 
                
> Fix concat for snapshots
> ------------------------
>
>                 Key: HDFS-4523
>                 URL: https://issues.apache.org/jira/browse/HDFS-4523
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: h4523_20130222.patch
>
>
> The use case of concat is for copying large files across clusters using the following steps.
> - Step 1: The blocks of a file in the source cluster are copied in parallel to transient files in the destination cluster.
> - Step 2: Then the transient files in the destination cluster are concatenated in order to obtain the original file.
> If a snapshot is taken in the destination cluster before Step 2, some transient files may be captured in the snapshot.  These transient files should be removed in Step 2.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira