You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Or Ozeri (Jira)" <ji...@apache.org> on 2019/11/27 09:20:00 UTC

[jira] [Created] (PARQUET-1704) [C++] Add re-usable encryption buffer to SerializedPageWriter

Or Ozeri created PARQUET-1704:
---------------------------------

             Summary: [C++] Add re-usable encryption buffer to SerializedPageWriter
                 Key: PARQUET-1704
                 URL: https://issues.apache.org/jira/browse/PARQUET-1704
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-cpp
            Reporter: Or Ozeri
         Attachments: profiler.png

SerializedPageWriter currently allocates a one-time buffer for each page encrypted.
We add a re-usable buffer to avoid the allocation and free overhead of these buffers.
This optimization already exists when decrypting (in SerializedPageReader).
Testing this optimization we found that it improves running time performance by ~15% (when encryption is on).

See attached screenshot of a profiler analysis, showing the overhead of re-allocating and freeing the buffer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)