[GitHub] [hive] pgaref commented on pull request #1823: HIVE-23553: Upgrade ORC version to 1.6.7

[GitBox <gi...@apache.org>]

pgaref commented on pull request #1823:
URL: https://github.com/apache/hive/pull/1823#issuecomment-769755146


   > I only partially reviewed this. Will continue reviewing.
   > One question: I see we do not care about column encryption related arguments in multiple places. Is it because column encryption is not supported?
   
   Hey @mustage good question with a complicated answer -- while creating this I also did some digging to find out whats supported and what not. To sum up my findings: 
   
   -  It looks like we are currently able to encrypt entire tables and/or data on hdfs using kms: HIVE-8065
   -  Support for column level encryption/decryption (passing some encryption setting to the Table props and let Hive take care of the rest) started more than a while ago as part of HIVE-6329 
   -  There was a community discussion as part of HIVE-21848 to unify encryption table properties (at least for ORC and Parquet) that concluded in the accepted options
   - However, these properties are still not propagated to the tables: HIVE-21849
   
   I believe part of the reason is that Hive already integrates with Apache Ranger that can restrict user access to particular columns and also adds data-masking on top.
   However, I am more than happy discussing the revival of column encryption at some point.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org