You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Kai Zheng (JIRA)" <ji...@apache.org> on 2014/11/12 11:24:34 UTC

[jira] [Reopened] (HDFS-7363) Pluggable algorithms to form block groups in erasure coding

     [ https://issues.apache.org/jira/browse/HDFS-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kai Zheng reopened HDFS-7363:
-----------------------------
      Assignee: Kai Zheng

Let me reuse this item as a sub task of HDFS-7337, where BlockGrouper is defined for this purpose as part of a codec. Its role:
Given desired data blocks, BlockGrouper calculates and arranges a BlockGroup for encoding. Different code can have different layout about a BlockGroup. In LRC(6, 2, 2), we have 3 child block groups: 2 local groups plus 1 global group; In RS, we have 1 block group. Given a BlockGroup with some blocks missing, BlockGroups also calculates and determines how to recover if recoverable, like using which blocks to recover a missing block. With such information the corresponding ErasureCoder can 
perform the concrete decoding work. 

> Pluggable algorithms to form block groups in erasure coding
> -----------------------------------------------------------
>
>                 Key: HDFS-7363
>                 URL: https://issues.apache.org/jira/browse/HDFS-7363
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Kai Zheng
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)