You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Volodymyr Vysotskyi (JIRA)" <ji...@apache.org> on 2019/01/30 16:59:00 UTC

[jira] [Commented] (DRILL-7017) lz4 codec for (un)compression

    [ https://issues.apache.org/jira/browse/DRILL-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756328#comment-16756328 ] 

Volodymyr Vysotskyi commented on DRILL-7017:
--------------------------------------------

Please see examples of usage of querying compressed files here: [https://drill.apache.org/docs/querying-plain-text-files/#querying-compressed-files].


 {{hadoop-common}} already contains lz4 compressors/decompressors. So it is possible that this compression is already supported. Not sure about the full list of codecs, but I think it may be extended by specifying additional codecs in {{io.compression.codecs}} in hadoop conf file (perhaps in {{core-site.xml}}).

> lz4 codec for (un)compression
> -----------------------------
>
>                 Key: DRILL-7017
>                 URL: https://issues.apache.org/jira/browse/DRILL-7017
>             Project: Apache Drill
>          Issue Type: Wish
>          Components: Storage - Text &amp; CSV
>    Affects Versions: 1.15.0
>            Reporter: benj
>            Priority: Major
>
> I didn't find in the documentation what compression formats are supported. But as it's possible to use drill on compressed file, like
> {code:java}
> SELECT * FROM tmp.`myfile.csv.gz`;
> {code}
> It will be useful to have the possibility to use this functionality for lz4 file ([https://github.com/lz4/lz4)]
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)