You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Kai Zheng (JIRA)" <ji...@apache.org> on 2014/11/04 07:43:34 UTC

[jira] [Created] (HDFS-7344) Erasure Coding worker and support in DataNode

Kai Zheng created HDFS-7344:
-------------------------------

             Summary: Erasure Coding worker and support in DataNode
                 Key: HDFS-7344
                 URL: https://issues.apache.org/jira/browse/HDFS-7344
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: datanode
    Affects Versions: HDFS-EC
            Reporter: Kai Zheng
            Assignee: Kai Zheng


According to HDFS-7285 and the design, this handles DataNode side extension and related support for Erasure Coding, and implements ECWorker. It mainly covers the following aspects, and separate tasks may be opened to handle each of them.
* Process encoding work, calculating parity blocks as specified in block groups and codec schema;
* Process decoding work, recovering data blocks according to block groups and codec schema;
* Handle client requests for passive recovery blocks data and serving data on demand while reconstructing;
* Write parity blocks according to storage policy.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)