[GitHub] [iceberg] JMin824 commented on issue #6373: Question about usage of RewriteFile with Zorder Strategy

[GitBox <gi...@apache.org>]

JMin824 commented on issue #6373:
URL: https://github.com/apache/iceberg/issues/6373#issuecomment-1340297485

   > * If you only add enough data for a single file it is most likely not going to help if that single file has been ZOrdered all by itself. Z ordering as we have it currently implemented can only really help across multiple files being ZOrdered at the same time. This is similar to if you were just doing a normal sort, sorting a single file in isolation would not change the min/max stats of that file so it wouldn't help iceberg.
   > * We currently do not have the ability to have ZOrder as a table defined sort order yet. There are tickets for that but currently if you wanted to take advantage of ZOrdering you would need to use rewrite again. Again like with normal sort, you would only gain the benefit from effected files.
   
   I find there is an option named rewrite-all in RewriteFile. if I use it in Zorder when I add enough data and some new files are created, what will happen? old files will not be rewritten? I guess it costs less than rewriting all file and maybe the query is a little slower than rewriting all file. thanks a lot for your reply


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org