[GitHub] [iceberg] szehon-ho commented on pull request #6760: Spark 3.3: use a deterministic where condition to make rewrite_data_files…

["szehon-ho (via GitHub)" <gi...@apache.org>]

szehon-ho commented on PR #6760:
URL: https://github.com/apache/iceberg/pull/6760#issuecomment-1430283445

   Hi @ludlows , im not too familiar with Spark side , but wondering , doesnt the RewriteDataFiles procedure already do a check to skip if there are no matching data files?  Ref:  https://github.com/apache/iceberg/blob/master/spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/actions/RewriteDataFilesSparkAction.java#L177   Not sure if we have a huge savings?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org