You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Maxim Gekk (JIRA)" <ji...@apache.org> on 2018/07/27 21:20:00 UTC

[jira] [Created] (SPARK-24952) Support LZMA2 compression by Avro datasource

Maxim Gekk created SPARK-24952:
----------------------------------

             Summary: Support LZMA2 compression by Avro datasource
                 Key: SPARK-24952
                 URL: https://issues.apache.org/jira/browse/SPARK-24952
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: Maxim Gekk


LZMA2 (XZ) has much more better compression ratio comparing to currently supported snappy and deflate. Underlying Avro library supports the compression codec already. Need to set parameters for the codec and allow users to specify "xz" compression via AvroOptions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org