You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/12/02 14:48:00 UTC

[jira] [Updated] (PARQUET-1704) [C++] Add re-usable encryption buffer to SerializedPageWriter

     [ https://issues.apache.org/jira/browse/PARQUET-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney updated PARQUET-1704:
----------------------------------
    Fix Version/s:     (was: 1.11.0)
                   cpp-1.6.0

> [C++] Add re-usable encryption buffer to SerializedPageWriter
> -------------------------------------------------------------
>
>                 Key: PARQUET-1704
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1704
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-cpp
>            Reporter: Or Ozeri
>            Assignee: Or Ozeri
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: cpp-1.6.0
>
>         Attachments: profiler.png
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> SerializedPageWriter currently allocates a one-time buffer for each page encrypted.
>  We add a re-usable buffer to avoid the allocation and free overhead of these buffers.
>  This optimization already exists when decrypting (in SerializedPageReader).
>  Testing this optimization we found that it improves running time performance by ~25% (when encryption is on).
> See attached screenshot of a profiler analysis, showing the overhead of re-allocating and freeing the buffer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)