You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@parquet.apache.org by "Gabor Szadovszky (Jira)" <ji...@apache.org> on 2024/02/21 13:38:00 UTC

[jira] [Created] (PARQUET-2436) More optimal memory usage in compression codecs

Gabor Szadovszky created PARQUET-2436:
-----------------------------------------

             Summary: More optimal memory usage in compression codecs
                 Key: PARQUET-2436
                 URL: https://issues.apache.org/jira/browse/PARQUET-2436
             Project: Parquet
          Issue Type: Improvement
            Reporter: Gabor Szadovszky
            Assignee: Gabor Szadovszky


Some of our current compressors/decompressors does unnecessary memory copies, suboptimal native calls (e.g. DirectZstd). The goal here is to use a ByteBufferAllocator wherever an allocation is necessary or rewrite if we can avoid memory copies. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org