You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Alexander Behm (JIRA)" <ji...@apache.org> on 2017/04/05 18:52:41 UTC

[jira] [Created] (IMPALA-5170) Streaming gzip decompression for Avro files

Alexander Behm created IMPALA-5170:
--------------------------------------

             Summary: Streaming gzip decompression for Avro files
                 Key: IMPALA-5170
                 URL: https://issues.apache.org/jira/browse/IMPALA-5170
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 2.5.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0
            Reporter: Alexander Behm


To reduce the memory consumption of scans over gzip-compressed Avro data, we should implement streaming decompression (gzip supports it).

Note that our text scanners already perform streaming decompression by default, but that's not the case for other scanners (e.g. Avro).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)