You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/12/02 14:48:00 UTC
[jira] [Updated] (PARQUET-1704) [C++] Add re-usable encryption
buffer to SerializedPageWriter
[ https://issues.apache.org/jira/browse/PARQUET-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney updated PARQUET-1704:
----------------------------------
Fix Version/s: (was: 1.11.0)
cpp-1.6.0
> [C++] Add re-usable encryption buffer to SerializedPageWriter
> -------------------------------------------------------------
>
> Key: PARQUET-1704
> URL: https://issues.apache.org/jira/browse/PARQUET-1704
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-cpp
> Reporter: Or Ozeri
> Assignee: Or Ozeri
> Priority: Major
> Labels: pull-request-available
> Fix For: cpp-1.6.0
>
> Attachments: profiler.png
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> SerializedPageWriter currently allocates a one-time buffer for each page encrypted.
> We add a re-usable buffer to avoid the allocation and free overhead of these buffers.
> This optimization already exists when decrypting (in SerializedPageReader).
> Testing this optimization we found that it improves running time performance by ~25% (when encryption is on).
> See attached screenshot of a profiler analysis, showing the overhead of re-allocating and freeing the buffer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)