[jira] [Commented] (AVRO-2195) Add Zstandard Codec

["Niels Basjes (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AVRO-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529497#comment-16529497 ] 

Niels Basjes commented on AVRO-2195:
------------------------------------

Thanks for putting up this contribution.

An important feature of Avro is being crossplatform/crosslanguage so I am very curious regarding the portability of this compressor across languages.

Simply put: does it exist outside the Java world?

I have not yet had a good look at your code.

A few small first feedback points:
 * A tiny typo in the comment  /** zstanard codec.*/
 * That dependency you mentioned seems to be a known limitation: [https://commons.apache.org/proper/commons-compress/limitations.html]
 * I would really like to see the tests.

> Add Zstandard Codec
> -------------------
>
>                 Key: AVRO-2195
>                 URL: https://issues.apache.org/jira/browse/AVRO-2195
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.9.0
>            Reporter: Benson Qiu
>            Priority: Major
>              Labels: patch
>         Attachments: AVRO-2195.patch
>
>
> Inspired by AVRO-1373. The Zstandard algorithm is available in the commons-library, which Avro projects already depend on.
> In a quick test that I did, Zstandard had a better compression ratio than deflate (compression level 9).
> [https://code.fb.com/core-data/smaller-and-faster-data-compression-with-zstandard/] 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)