You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "bmaisonn (via GitHub)" <gi...@apache.org> on 2023/07/07 15:52:48 UTC
[GitHub] [iceberg] bmaisonn commented on issue #7822: CDC data inconsistencies with schema changes
bmaisonn commented on issue #7822:
URL: https://github.com/apache/iceberg/issues/7822#issuecomment-1625615165
@flyrain @RussellSpitzer here is a notebook with a concrete example of what we found out https://github.com/bmaisonn/iceberg_tests/blob/main/cdc.md
We'd be happy contributing but i'm not really sure what could be the good behavior here when the schema is altered. In our use case we'd like to see the changes as they were applied when the snapshots were generated and the corresponding schema but that might be difficult to represent clearly in a table when the changelog spans multiple snapshots.
Note that our workaround for now will be to ensure that we export the changelog before any schema modification
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org