You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jerry Chen (JIRA)" <ji...@apache.org> on 2013/09/26 09:36:02 UTC

[jira] [Updated] (HADOOP-9997) Improve TFile API to be able to pass the context for encryption codecs

     [ https://issues.apache.org/jira/browse/HADOOP-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jerry Chen updated HADOOP-9997:
-------------------------------

    Description: 
HADOOP-9996 extends TFile to support any compression codecs available in Hadoop, such as Snappy. This also provides the opportunity to utilize the crypto codec for encryption, a new feature added by HADOOP-9331. The crypto codec is based on the compression codec and it is a natural extension of its usage here. While in API level encryption usually needs a key context while compression usually doesn’t.

This work needs to extend the TFile Reader and Writer to passing and handling a context of the codec. For crypto codecs, this may be the key information for using to encrypt or decrypt the data. To keep the backward compatibility of the reader and writer, new methods or constructor with codec context can be added instead of modifying the existing methods.


  was:
HADOOP-9996 extends TFile to support any compression codecs available in Hadoop, such as Snappy. This also provides the opportunity to utilize the crypto codec for encryption, a new feature added by HADOOP-9331. The crypto codec is based on the compression codec and it is a natural extension of its usage here. While in API level encryption usually needs a key context while compression usually doesn’t.

This work needs to extend the TFile Reader and Writer to passing and handling a context of the codec. For crypo codecs, this may be the key information for using to encrypt or decrypt the data. To keep the backward compatibility of the reader and writer, new methods or constructor with codec context can be added instead of modifying the existing methods.


    
> Improve TFile API to be able to pass the context for encryption codecs
> ----------------------------------------------------------------------
>
>                 Key: HADOOP-9997
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9997
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 3.0.0
>            Reporter: Jerry Chen
>              Labels: Rhino
>   Original Estimate: 72h
>  Remaining Estimate: 72h
>
> HADOOP-9996 extends TFile to support any compression codecs available in Hadoop, such as Snappy. This also provides the opportunity to utilize the crypto codec for encryption, a new feature added by HADOOP-9331. The crypto codec is based on the compression codec and it is a natural extension of its usage here. While in API level encryption usually needs a key context while compression usually doesn’t.
> This work needs to extend the TFile Reader and Writer to passing and handling a context of the codec. For crypto codecs, this may be the key information for using to encrypt or decrypt the data. To keep the backward compatibility of the reader and writer, new methods or constructor with codec context can be added instead of modifying the existing methods.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira