You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2026/01/26 20:31:00 UTC

[jira] [Created] (IMPALA-14700) Add support for Parquet's LZ4_RAW compression

Joe McDonnell created IMPALA-14700:
--------------------------------------

             Summary: Add support for Parquet's LZ4_RAW compression
                 Key: IMPALA-14700
                 URL: https://issues.apache.org/jira/browse/IMPALA-14700
             Project: IMPALA
          Issue Type: Task
          Components: Backend
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


Parquet's current LZ4 compression uses a framing mechanism from Hadoop. Parquet decided to deprecate this and instead introduced the LZ4_RAW compression without the Hadoop framing. See https://issues.apache.org/jira/browse/PARQUET-1996 / https://issues.apache.org/jira/browse/PARQUET-2032

We should add support for reading / writing LZ4_RAW. This should be fairly simple, as LZ4_RAW just uses the block compression directly. It should correspond to Lz4Compressor rather than Lz4BlockCompressor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)