You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Steven Anton (JIRA)" <ji...@apache.org> on 2016/08/15 19:56:20 UTC

[jira] [Created] (PARQUET-678) Allow for custom compression codecs

Steven Anton created PARQUET-678:
------------------------------------

             Summary: Allow for custom compression codecs
                 Key: PARQUET-678
                 URL: https://issues.apache.org/jira/browse/PARQUET-678
             Project: Parquet
          Issue Type: Wish
            Reporter: Steven Anton
            Priority: Minor


I understand that the list of accepted compression codecs is explicity limited to uncompressed, snappy, gzip, and lzo. (See parquet.hadoop.metadata.CompressionCodecName.java) Is there a reason for this? Or is there an easy workaround? On the surface it seems like an unnecessary restriction.

I ask because I have written a custom codec to implement encryption and I'm unable to use it with Parquet, which is a real shame because it is the main storage format I was hoping to use.

Other thoughts on how to implement encryption in Parquet with this limitation?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)