You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Xinli Shang (JIRA)" <ji...@apache.org> on 2018/06/14 14:20:00 UTC

[jira] [Updated] (PARQUET-1325) Flexible and finer-grained column level access control through encryption

     [ https://issues.apache.org/jira/browse/PARQUET-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xinli Shang updated PARQUET-1325:
---------------------------------
    Description: 
This JIRA is an extension to Modular Encryption Jira(PARQUET-1178) that will provide basic encryption support. This feature will enable finer-grained and flexible column level access control. Specifically, this will primarily allow a) individual encryption key for each column b) pluggable key access module c) seamless integration with existing clients.
A detailed design doc will follow soon.

  was:
PARQUET-1178 proposed a mechanism for modular encryption and decryption of Parquet files. On top of it, another layer needs to be added to wrap up the details of the usage of encryption/decryption to shield upper layer application like Spark, Presto, Hive transparent. 

The goal is no changes in the existing systems (i.e. Hive, Presto, Spark  etc)
 * Only update the parquet library and config
 * Parquet schema should control the access

The code could be like below. 

*ParquetWriter* (..., schema, ….) {

      if(schema.hasCryptoColumn() && keys == null)

{                    Keys = PluggableKeyManagement.getKeys(schema)      }

     ……….

}

        Summary: Flexible and finer-grained column level access control through encryption  (was: Parquet column access control support )

> Flexible and finer-grained column level access control through encryption
> -------------------------------------------------------------------------
>
>                 Key: PARQUET-1325
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1325
>             Project: Parquet
>          Issue Type: New Feature
>          Components: parquet-mr
>    Affects Versions: 1.10.1
>            Reporter: Xinli Shang
>            Priority: Major
>              Labels: None
>             Fix For: 1.10.1
>
>   Original Estimate: 1,440h
>  Remaining Estimate: 1,440h
>
> This JIRA is an extension to Modular Encryption Jira(PARQUET-1178) that will provide basic encryption support. This feature will enable finer-grained and flexible column level access control. Specifically, this will primarily allow a) individual encryption key for each column b) pluggable key access module c) seamless integration with existing clients.
> A detailed design doc will follow soon.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)