You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Zhe Zhang (JIRA)" <ji...@apache.org> on 2016/03/16 07:29:33 UTC

[jira] [Commented] (HADOOP-12924) Add default coder key for creating raw coders

    [ https://issues.apache.org/jira/browse/HADOOP-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196858#comment-15196858 ] 

Zhe Zhang commented on HADOOP-12924:
------------------------------------

Thanks Rui. Patch itself LGTM.

However I realized some issues in the current code. Pinging [~drankye] for discussion.

Kai mentioned that new RS Java coder and legacy RS coder from HDFS-RAID are not interoperable. However, they map to the same EC policy at inode level. E.g. if a client writes a file using HDFS-RAID coder, we will record EC policy RS-6-3. Then if another client tries to decode the file with new coder it will fail. These 2 clients could have different {{IO_ERASURECODE_CODEC_RS_RAWCODER_KEY}} configured. IIUC, they should be treated as 2 different policies rather than 2 different implementations?

> Add default coder key for creating raw coders
> ---------------------------------------------
>
>                 Key: HADOOP-12924
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12924
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>         Attachments: HADOOP-12924.1.patch
>
>
> As suggested [here|https://issues.apache.org/jira/browse/HADOOP-12826?focusedCommentId=15194402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15194402].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)