You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "boroknagyz (via GitHub)" <gi...@apache.org> on 2024/02/22 18:30:14 UTC
[PR] Core: RowDelta should conflict with RewriteFiles operation [iceberg]
boroknagyz opened a new pull request, #9781:
URL: https://github.com/apache/iceberg/pull/9781
RewriteFiles might be used to compact a table, e.g. it can replace lots of small files with a few big files. Concurrent RowDelta (DELETE/ UPDATE) operations must fail, because they can put the table in an inconsistent state.
A successful DELETE (with merge-on-read) can become a no-op as the position delete files refer to the replaced small files.
A successful UPDATE (with merge-on-read) can duplicate rows as the delete files refer to the replaced small files, and it also adds its own data files.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Core: RowDelta should conflict with RewriteFiles operation [iceberg]
Posted by "boroknagyz (via GitHub)" <gi...@apache.org>.
boroknagyz commented on PR #9781:
URL: https://github.com/apache/iceberg/pull/9781#issuecomment-1972699931
Thanks @amogh-jahagirdar for taking a look. Then it seems to be a bug in Hive and Impala.
Filed
- https://issues.apache.org/jira/browse/HIVE-28102
- https://issues.apache.org/jira/browse/IMPALA-12860
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] Core: RowDelta should conflict with RewriteFiles operation [iceberg]
Posted by "boroknagyz (via GitHub)" <gi...@apache.org>.
boroknagyz closed pull request #9781: Core: RowDelta should conflict with RewriteFiles operation
URL: https://github.com/apache/iceberg/pull/9781
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org