You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@avro.apache.org by "Sean Busbey (JIRA)" <ji...@apache.org> on 2018/03/22 15:16:00 UTC

[jira] [Commented] (AVRO-2162) Add Zstandard compression to avro file format

    [ https://issues.apache.org/jira/browse/AVRO-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409699#comment-16409699 ] 

Sean Busbey commented on AVRO-2162:
-----------------------------------

this would be great!

> Add Zstandard compression to avro file format
> ---------------------------------------------
>
>                 Key: AVRO-2162
>                 URL: https://issues.apache.org/jira/browse/AVRO-2162
>             Project: Avro
>          Issue Type: Improvement
>          Components: java
>            Reporter: Scott Carey
>            Priority: Major
>
> I'd like to add Zstandard compression for Avro. 
> At compression level 1 It is almost as fast as Snappy at compression, with compression ratios more like gzip.  At higher levels of compression, it is more compact than gzip -9 with much lower CPU when compressing and roughly 3x faster decompression.
>  
> Adding it to Java is fairly easy.  We'll need to say something about it in the spec however, as an 'optinal' codec.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)