[GitHub] [iceberg] gaborkaszab commented on a diff in pull request #6771: Docs: Document that partitions metadata table might show 'old' partitions

["gaborkaszab (via GitHub)" <gi...@apache.org>]

gaborkaszab commented on code in PR #6771:
URL: https://github.com/apache/iceberg/pull/6771#discussion_r1102539567


##########
docs/spark-queries.md:
##########
@@ -346,6 +346,9 @@ SELECT * FROM prod.db.table.partitions;
 Note:
 For unpartitioned tables, the partitions table will contain only the record_count and file_count columns.
 
+Note2:
+The output of the above query might differ between having copy-on-write or merge-on-read strategies. E.g. delete files with MOR strategy aren't applyied when producing the content of the partitions metadata table. As a result if you have renamed a partition (by updating the value of a partition column) then you would see both the 'old' and the 'new' one until you do a rewrite of delete/data files.

Review Comment:
   Thanks for the analysis @szehon-ho! I'm fine adding the proposed comment if there is consensus.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org