[jira] [Commented] (HADOOP-11828) Implement the Hitchhiker erasure coding algorithm

["Rashmi Vinayak (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044185#comment-15044185 ] 

Rashmi Vinayak commented on HADOOP-11828:
-----------------------------------------

[~jack_liuquan], [~drankye]: I think we can make significantly more impact if we move faster and get this out soon: More systems will use the code and EC in general if this more efficient code is available when they are deciding whether to use EC or not. 
Do let me know when it would be appropriate to start with the algo review. Also, as we discussed, once we have (10,4), I will work on implementing for general parameters.
[~jack_liuquan]: Feel free to let us know if there are any bottlenecks.


> Implement the Hitchhiker erasure coding algorithm
> -------------------------------------------------
>
>                 Key: HADOOP-11828
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11828
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: jack liuquan
>         Attachments: 7715-hitchhikerXOR-v2-testcode.patch, 7715-hitchhikerXOR-v2.patch, HADOOP-11828-hitchhikerXOR-V3.patch, HADOOP-11828-hitchhikerXOR-V4.patch, HDFS-7715-hhxor-decoder.patch, HDFS-7715-hhxor-encoder.patch
>
>
> [Hitchhiker | http://www.eecs.berkeley.edu/~nihar/publications/Hitchhiker_SIGCOMM14.pdf] is a new erasure coding algorithm developed as a research project at UC Berkeley. It has been shown to reduce network traffic and disk I/O by 25%-45% during data reconstruction. This JIRA aims to introduce Hitchhiker to the HDFS-EC framework, as one of the pluggable codec algorithms.
> The existing implementation is based on HDFS-RAID. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)