[GitHub] [iceberg] ggershinsky commented on issue #1413: Support Parquet modular encryption

[GitBox <gi...@apache.org>]

ggershinsky commented on issue #1413:
URL: https://github.com/apache/iceberg/issues/1413#issuecomment-798879208


   Hi @shangxinli , I guess you are using a custom Parquet integration code. The way Iceberg calls the Parquet APIs today (in the master branch), doesn't allow for transparent activation of Parquet encryption via crypto factories. I had to make some code modifications in both writer and reader parts in order to have Iceberg create/query data tables with encrypted Parquet files.  Details TBD, but I believe they are not very important; this might be split into two phases - a near-term, that integrates the current Iceberg with Parquet encryption (one way or another), and a longer-term, that will depend on the progress of a bigger subject of the future approach to a general Iceberg/Parquet integration.
   
   As a side note - all this is about the basic mechanics of the Iceberg/PME calls. There are additional table security questions / challenges, beyond the direct scope of this subject.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org