You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Scott Carey (JIRA)" <ji...@apache.org> on 2018/03/22 07:40:00 UTC
[jira] [Updated] (AVRO-2162) Add Zstandard compression to avro file
format
[ https://issues.apache.org/jira/browse/AVRO-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Scott Carey updated AVRO-2162:
------------------------------
Description:
I'd like to add Zstandard compression for Avro.
At compression level 1 It is almost as fast as Snappy at compression, with compression ratios more like gzip. At higher levels of compression, it is more compact than gzip -9 with much lower CPU when compressing and roughly 3x faster decompression.
Adding it to Java is fairly easy. We'll need to say something about it in the spec however, as an 'optinal' codec.
was:
I'd like to add Zstandard compression for Avro.
It is almost as fast as Snappy at compression, with compression ratios more like gzip. At higher levels of compression, it is more compact than gzip -9 with much lower CPU when compressing and roughly 3x faster decompression.
Adding it to Java is fairly easy. We'll need to say something about it in the spec however, as an 'optinal' codec.
> Add Zstandard compression to avro file format
> ---------------------------------------------
>
> Key: AVRO-2162
> URL: https://issues.apache.org/jira/browse/AVRO-2162
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Scott Carey
> Priority: Major
>
> I'd like to add Zstandard compression for Avro.
> At compression level 1 It is almost as fast as Snappy at compression, with compression ratios more like gzip. At higher levels of compression, it is more compact than gzip -9 with much lower CPU when compressing and roughly 3x faster decompression.
>
> Adding it to Java is fairly easy. We'll need to say something about it in the spec however, as an 'optinal' codec.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)