You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Yi Liu (JIRA)" <ji...@apache.org> on 2015/05/12 14:13:00 UTC

[jira] [Updated] (HADOOP-11961) Add interface of whether codec has chunk boundary to Erasure coder

     [ https://issues.apache.org/jira/browse/HADOOP-11961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yi Liu updated HADOOP-11961:
----------------------------
    Description:     (was: Today, we have a discussion including [~zhz], [~drankye], etc., also discuss in HDFS-8347.
Some coder like {{RS}} and {{XOR}} is linear, some have coding boundary like HitchHicker.  If the coder is linear, we can decode at any size, and we don't need to padding inputs to *chunksize*,  if the coder is not linear, the inputs need to padding to *chunksize*, then do decode.

This interface is important for performance, and can save memory/disk space since the parity cells are the same as first data cell (less than codec chunksize).  )
       Assignee:     (was: Yi Liu)
        Summary: Add interface of whether codec has chunk boundary to Erasure coder  (was: Add isLinear interface to Erasure coder)

> Add interface of whether codec has chunk boundary to Erasure coder
> ------------------------------------------------------------------
>
>                 Key: HADOOP-11961
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11961
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: io
>            Reporter: Yi Liu
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)