You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Xinli Shang (Jira)" <ji...@apache.org> on 2021/08/05 15:02:00 UTC

[jira] [Updated] (PARQUET-2075) Unified translation tool

     [ https://issues.apache.org/jira/browse/PARQUET-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xinli Shang updated PARQUET-2075:
---------------------------------
    External issue ID: https://issues.apache.org/jira/browse/PARQUET-2071

> Unified translation tool  
> --------------------------
>
>                 Key: PARQUET-2075
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2075
>             Project: Parquet
>          Issue Type: New Feature
>            Reporter: Xinli Shang
>            Assignee: Xinli Shang
>            Priority: Major
>
> During the discussion of PARQUET-2071, we came up with the idea of a universal tool to translate the existing file to a different state while skipping some level steps like encoding/decoding, to gain speed. For example, only decompress pages and then compress directly. For PARQUET-2071, we only decrypt and then encrypt directly. This will be useful for the existing data to onboard Parquet features like column encryption, zstd etc. 
> We already have tools like trans-compression, column pruning etc. We will consolidate all these tools with this universal tool. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)