You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Wei-Chiu Chuang (JIRA)" <ji...@apache.org> on 2016/09/27 17:32:20 UTC

[jira] [Updated] (HADOOP-13665) Erasure Coding codec should support fallback coder

     [ https://issues.apache.org/jira/browse/HADOOP-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wei-Chiu Chuang updated HADOOP-13665:
-------------------------------------
    Description: 
The current EC codec supports a single coder only (by default pure Java implementation). If the native coder is specified but is unavailable, it should fallback to pure Java implementation.

One possible solution is to follow the convention of existing Hadoop native codec, such as transport encryption (see {{CryptoCodec.java}}). It supports fallback by specifying two or multiple coders as the value of property, and loads coders in order.

  was:
I think EC issues should be reported in HDFS, but the code lands in Hadoop Common anyway.

The current EC codec supports a single coder only (by default pure Java implementation). If the native coder is specified but is unavailable, it should fallback to pure Java implementation.

One possible solution is to follow the convention of existing Hadoop native codec, such as transport encryption (see {{CryptoCodec.java}}). It supports fallback by specifying two or multiple coders as the value of property, and loads coders in order.


> Erasure Coding codec should support fallback coder
> --------------------------------------------------
>
>                 Key: HADOOP-13665
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13665
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: io
>            Reporter: Wei-Chiu Chuang
>
> The current EC codec supports a single coder only (by default pure Java implementation). If the native coder is specified but is unavailable, it should fallback to pure Java implementation.
> One possible solution is to follow the convention of existing Hadoop native codec, such as transport encryption (see {{CryptoCodec.java}}). It supports fallback by specifying two or multiple coders as the value of property, and loads coders in order.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org