[jira] Updated: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

["Hairong Kuang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HDFS-543:
-------------------------------

    Attachment: writeToReplica.patch

This patch
1. replaces writeToBlock by append, writeToTemporary, and writeToRbw to FSDatasetInterface and implements these 3 APIs in both FSDataset and SimulatedFSDataset.
2. Changes ReplicaInPipeline to make sure that each replica has only one writer.
3. When DataNode starts, replicas under tmp are removed.
4. Starting from this patch, any replicas created by a client are initially placed under rbw sbudir and are loaded as RWR (ReplicaWaitingToBeRecovered) at DataNode startup time. RWR replicas are sent as part of block reports. Finalized & RWR are not distinguished in a block report for now.

> Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append
> -------------------------------------------------------------------------------------
>
>                 Key: HDFS-543
>                 URL: https://issues.apache.org/jira/browse/HDFS-543
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: data-node
>    Affects Versions: Append Branch
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: Append Branch
>
>         Attachments: writeToReplica.patch
>
>
> FSDatasetInterface#writeToBlock() currently allows to create/recover a temporary replica, create/recover a RBW replica, or append to a replica. The implementation of the method in FSDataset is very complicated and error prone. I'd like to break this method into 3:
> 1. writeToTemporary allows to create a Temporary replica or recover from a packet error for a Tempoary replica;
> 2. writeToRBW allows to create a RBW replica or recover from a packet error for a RBW replica;
> 3. append allows to append to an existing Finalized replica.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.