[GitHub] [iceberg] atronchi commented on issue #732: [DISCUSS] Update metadata serially

[GitBox <gi...@apache.org>]

atronchi commented on issue #732:
URL: https://github.com/apache/iceberg/issues/732#issuecomment-1028467451


   For a more realistic use case, consider swapping the partition name `identity` in @waterlx case above for `date`, and a backfill which needs to overwrite the partitions running many days in parallel. I found this thread from exactly this use case, which triggered a deluge of Spark job failures failing on the `CommitFailedException`. Probably Spark should retry the commit in such cases instead of hard failing the job, which requires us to re-run the execution.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org