[GitHub] [iceberg] RussellSpitzer commented on issue #6290: Spark SQL support for partition spec?

[GitBox <gi...@apache.org>]

RussellSpitzer commented on issue #6290:
URL: https://github.com/apache/iceberg/issues/6290#issuecomment-1329119528

   This is probably not necessary unless I am missing something. Unlike systems like Hive, individual partitions are implicit metadata constructs and don't have to be explicitly created or modified through DDL. 
   
   The "spec" is the description of how fields are transformed to generate that metadata. So for example something like identity(column a) which allows files to state they have only values for a specific value of column a. Modifying this spec is allowed via our custom alter table commands. 
   
   Commands like drop partition x=5 just become delete statements in Iceberg where the engine determines whether it can be a metadata delete or not by analyzing all files in the table and their respective partition values as well as the spec used to write them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org