[GitHub] [iceberg] ajantha-bhat commented on issue #4161: Spark:CALL [rewrite_manifests] error Manifest is missing

[GitBox <gi...@apache.org>]

ajantha-bhat commented on issue #4161:
URL: https://github.com/apache/iceberg/issues/4161#issuecomment-1046041862


   > the expire_snapshots->rewrite_data_files->rewrite_manifests->remove_orphan_files of processing in a transaction is it correct?
   
   regarding the order I guess `expire_snapshots` should be called after `rewrite_data_files` files to clean up old data files which are compacted into the new files.
   
   No need to call  `remove_orphan_files` every time (as having orphan files is rare scenario) 
   
   And regarding the error on `rewrite_manifests`, 
   a. Is it a sequential operation or concurrent with other operations here?
   b. Is this problem only for table in hadoop catalog ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org