You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Ryan Blue (JIRA)" <ji...@apache.org> on 2017/10/07 00:14:00 UTC
[jira] [Commented] (PARQUET-1011) bzip2 compression
[ https://issues.apache.org/jira/browse/PARQUET-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195462#comment-16195462 ]
Ryan Blue commented on PARQUET-1011:
------------------------------------
We're trying to keep the number of codecs to a minimum and I don't think the performance of bzip2 justifies adding it to the small set of codecs in the spec compared to newer codecs like brotli and zstd.
> bzip2 compression
> ------------------
>
> Key: PARQUET-1011
> URL: https://issues.apache.org/jira/browse/PARQUET-1011
> Project: Parquet
> Issue Type: Improvement
> Reporter: Rajasekhar Konda
>
> Hi,
> I have a requirement to implement Parquet with bzip2 compression because it's splitable. Right now, we can't provide bzip2 in PIG.
> SET parquet.compression none/gzip/SNAPPY;
> Is there any way to compress to bzip2 on top parquet ?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)