You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Xinli Shang (JIRA)" <ji...@apache.org> on 2018/06/13 21:56:00 UTC
[jira] [Updated] (PARQUET-1325) Parquet column access control
support
[ https://issues.apache.org/jira/browse/PARQUET-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xinli Shang updated PARQUET-1325:
---------------------------------
Description:
PARQUET-1178 proposed a mechanism for modular encryption and decryption of Parquet files. On top of it, another lay need to be added to wrap up the details of the usage of encryption/decryption and shield upper layer application like Spark, Presto, Hive transparent.
The goal is no changes in the existing systems (i.e. Hive, Presto, Spark etc)
* Only update the parquet library and config
* Parquet schema should control the access
The code could be like below.
*ParquetWriter* (..., schema, ….) {
if(schema.hasCryptoColumn() && keys == null) {
Keys = PluggableKeyManagement.getKeys(schema)
}
……….
}
was:PARQUET-1178 proposed a mechanism for modular encryption and decryption of Parquet files. On top of it, another lay need to be added to wrap up the details of the usage of encryption/decryption and shield upper layer application like Spark, Presto, Hive transparent.
> Parquet column access control support
> --------------------------------------
>
> Key: PARQUET-1325
> URL: https://issues.apache.org/jira/browse/PARQUET-1325
> Project: Parquet
> Issue Type: New Feature
> Components: parquet-mr
> Affects Versions: 1.10.1
> Reporter: Xinli Shang
> Priority: Major
> Labels: None
> Fix For: 1.10.1
>
> Original Estimate: 1,440h
> Remaining Estimate: 1,440h
>
> PARQUET-1178 proposed a mechanism for modular encryption and decryption of Parquet files. On top of it, another lay need to be added to wrap up the details of the usage of encryption/decryption and shield upper layer application like Spark, Presto, Hive transparent.
> The goal is no changes in the existing systems (i.e. Hive, Presto, Spark etc)
> * Only update the parquet library and config
> * Parquet schema should control the access
> The code could be like below.
> *ParquetWriter* (..., schema, ….) {
> if(schema.hasCryptoColumn() && keys == null) {
> Keys = PluggableKeyManagement.getKeys(schema)
> }
> ……….
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)