[GitHub] [iceberg] rdblue commented on issue #1349: HadoopTableOperations might swallow IOException when doing commit

[GitBox <gi...@apache.org>]

rdblue commented on issue #1349:
URL: https://github.com/apache/iceberg/issues/1349#issuecomment-675136724


   The version hint file is just that -- a hint. It is not guaranteed to be correct because we cannot guarantee that two different FS operations complete successfully (the rename to commit, and the version hint update).
   
   To handle cases where the version hint is missing or incorrect, Iceberg should look for newer versions. If the version hint says the current version is 3, but v4.metadata.json exists, it should detect v4 and use that instead, and keep trying new version numbers until one does not exist.
   
   So the main problem here is that you had an incorrect read when the version hint was out of date.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org