You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Volodymyr Vysotskyi (JIRA)" <ji...@apache.org> on 2019/01/30 17:03:00 UTC
[jira] [Comment Edited] (DRILL-7017) lz4 codec for (un)compression
[ https://issues.apache.org/jira/browse/DRILL-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756328#comment-16756328 ]
Volodymyr Vysotskyi edited comment on DRILL-7017 at 1/30/19 5:02 PM:
---------------------------------------------------------------------
Please see example of querying compressed files here: [https://drill.apache.org/docs/querying-plain-text-files/#querying-compressed-files].
{{hadoop-common}} already contains lz4 compressors/decompressors. So it is possible that this compression is already supported. Not sure about the full list of codecs, but I think it may be extended by specifying additional codecs in {{io.compression.codecs}} in hadoop conf file (perhaps in {{core-site.xml}}).
was (Author: vvysotskyi):
Please see examples of usage of querying compressed files here: [https://drill.apache.org/docs/querying-plain-text-files/#querying-compressed-files].
{{hadoop-common}} already contains lz4 compressors/decompressors. So it is possible that this compression is already supported. Not sure about the full list of codecs, but I think it may be extended by specifying additional codecs in {{io.compression.codecs}} in hadoop conf file (perhaps in {{core-site.xml}}).
> lz4 codec for (un)compression
> -----------------------------
>
> Key: DRILL-7017
> URL: https://issues.apache.org/jira/browse/DRILL-7017
> Project: Apache Drill
> Issue Type: Wish
> Components: Storage - Text & CSV
> Affects Versions: 1.15.0
> Reporter: benj
> Priority: Major
>
> I didn't find in the documentation what compression formats are supported. But as it's possible to use drill on compressed file, like
> {code:java}
> SELECT * FROM tmp.`myfile.csv.gz`;
> {code}
> It will be useful to have the possibility to use this functionality for lz4 file ([https://github.com/lz4/lz4])
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)