You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Or Ozeri (Jira)" <ji...@apache.org> on 2019/11/27 09:20:00 UTC
[jira] [Created] (PARQUET-1704) [C++] Add re-usable encryption
buffer to SerializedPageWriter
Or Ozeri created PARQUET-1704:
---------------------------------
Summary: [C++] Add re-usable encryption buffer to SerializedPageWriter
Key: PARQUET-1704
URL: https://issues.apache.org/jira/browse/PARQUET-1704
Project: Parquet
Issue Type: Improvement
Components: parquet-cpp
Reporter: Or Ozeri
Attachments: profiler.png
SerializedPageWriter currently allocates a one-time buffer for each page encrypted.
We add a re-usable buffer to avoid the allocation and free overhead of these buffers.
This optimization already exists when decrypting (in SerializedPageReader).
Testing this optimization we found that it improves running time performance by ~15% (when encryption is on).
See attached screenshot of a profiler analysis, showing the overhead of re-allocating and freeing the buffer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)