Re: [I] Add support for encrypted/protected data type in iceberg table [iceberg-python]

["Fokko (via GitHub)" <gi...@apache.org>]

Fokko commented on issue #1582:
URL: https://github.com/apache/iceberg-python/issues/1582#issuecomment-2630481183

   As @kevinjqliu already pointed out, this is a bigger thing than just implementing it on PyIceberg. There is also a proposal out for file-level encryption: https://github.com/apache/iceberg/pull/12162/. For the implementation, I think there are a few more things to take into account. For example, when doing query optimization we use the min/max of the column from the Manifest file, we need to make sure to decrypt these as well before evaluating the metrics.
   
   > Do I need to implement different str / repr methods in the new data type, or I need to do it elsewhere?
   
   I think this is being [done on the `PrimitiveType`](https://github.com/apache/iceberg-python/blob/5018efc203b6393898a000d98e6f305f287e42a7/pyiceberg/types.py#L184-L190).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org