[GitHub] [iceberg] mrabisf commented on issue #6422: How compaction works along side incremental read

["mrabisf (via GitHub)" <gi...@apache.org>]

mrabisf commented on issue #6422:
URL: https://github.com/apache/iceberg/issues/6422#issuecomment-1518979122

   Real thanks for the detailed explanation @ChristinaTech.
   
   So, since incremental read doesn't use compacted files but the old files, would you suggest using incremental read only on rather small batches?
   
   Otherwise you suggest querying on partition time column with something like BETWEEN / > statement? Would that be of better performance since those queries use the compacted files.
   
   I'm just trying to understand the best practice for doing a hopping window on an Iceberg table.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org