[jira] Updated: (HDFS-544) Add a "rbw" sub directory to DataNode data directory

["Hairong Kuang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang updated HDFS-544:
-------------------------------

    Attachment: datanodeOnDiskLayout.patch

This patch
1. changes the datanode on-disk layout. The directory "current" has two subdirs: "finalized" has all finalized replicas and "rbw" has all replicas being written to.
2. when datanode restarts, it reads replicas under "finalized" and add them to the replicasMap as FinalizedReplica. It also reads replicas under "rbw" and adds them to the replicasMap as ReplicaWaitingToBeRecovered with its length set to be the number of bytes that match its crc.

> Add a "rbw" sub directory to DataNode data directory
> ----------------------------------------------------
>
>                 Key: HDFS-544
>                 URL: https://issues.apache.org/jira/browse/HDFS-544
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: data-node
>    Affects Versions: Append Branch
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: Append Branch
>
>         Attachments: datanodeOnDiskLayout.patch
>
>
> Add a "rbw" sub directory to DataNode to persist RBW, RWR, and RUR replicas.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.