You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Maya Anderson (Jira)" <ji...@apache.org> on 2022/03/23 07:51:00 UTC
[jira] [Updated] (ARROW-13593) [C++][Dataset][Parquet] Support parquet modular encryption in the new Dataset API
[ https://issues.apache.org/jira/browse/ARROW-13593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maya Anderson updated ARROW-13593:
----------------------------------
Description:
In order for the new Dataset API to fully support PME, the same writer properties that include file_encryption_properties shouldn’t be used for the whole dataset. file_encryption_properties should be per file, for example in order to support key rotation https://issues.apache.org/jira/browse/ARROW-9960 .
Design document: https://docs.google.com/document/d/1i1M5f5azLEmASj9XQZ_aQLl5Fr5F0CvnyPPVu1xaD9U/edit#bookmark=id.uim2w8aj6s1x
was:In order for the new Dataset API to fully support PME, the same writer properties that include file_encryption_properties shouldn’t be used for the whole dataset. file_encryption_properties should be per file, for example in order to support key rotation https://issues.apache.org/jira/browse/ARROW-9960 .
> [C++][Dataset][Parquet] Support parquet modular encryption in the new Dataset API
> ---------------------------------------------------------------------------------
>
> Key: ARROW-13593
> URL: https://issues.apache.org/jira/browse/ARROW-13593
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++, Parquet
> Reporter: Maya Anderson
> Assignee: Maya Anderson
> Priority: Major
>
> In order for the new Dataset API to fully support PME, the same writer properties that include file_encryption_properties shouldn’t be used for the whole dataset. file_encryption_properties should be per file, for example in order to support key rotation https://issues.apache.org/jira/browse/ARROW-9960 .
> Design document: https://docs.google.com/document/d/1i1M5f5azLEmASj9XQZ_aQLl5Fr5F0CvnyPPVu1xaD9U/edit#bookmark=id.uim2w8aj6s1x
--
This message was sent by Atlassian Jira
(v8.20.1#820001)