You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2019/04/24 23:50:00 UTC
[jira] [Updated] (IMPALA-8450) Add support for zstd and lz4 in
parquet
[ https://issues.apache.org/jira/browse/IMPALA-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong updated IMPALA-8450:
----------------------------------
Description:
PARQUET-970 added these codecs to the format. We have LZ4 in the toolchain already and I just added zstd: https://gerrit.cloudera.org/#/c/13079/
These codec probably offer a better trade-off of density and speed than snappy or gzip.
https://github.com/apache/arrow/pull/807/files might be a useful crib sheet for how to add a compressor.
was:
PARQUET-970 added these codecs to the format. We have LZ4 in the toolchain already and I just added zstd: https://gerrit.cloudera.org/#/c/13079/
These codec probably offer a better trade-off of density and speed than snappy or gzip.
> Add support for zstd and lz4 in parquet
> ---------------------------------------
>
> Key: IMPALA-8450
> URL: https://issues.apache.org/jira/browse/IMPALA-8450
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Reporter: Tim Armstrong
> Priority: Major
> Labels: parquet
>
> PARQUET-970 added these codecs to the format. We have LZ4 in the toolchain already and I just added zstd: https://gerrit.cloudera.org/#/c/13079/
> These codec probably offer a better trade-off of density and speed than snappy or gzip.
> https://github.com/apache/arrow/pull/807/files might be a useful crib sheet for how to add a compressor.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org