You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "mxm (via GitHub)" <gi...@apache.org> on 2026/09/04 10:58:22 UTC
Re: [I] Data loss with FlinkSink (v1) - due to unaligned checkpoints? [iceberg]
mxm commented on issue #15846:
URL: https://github.com/apache/iceberg/issues/15846#issuecomment-5539458264
In https://github.com/apache/iceberg/pull/15913 we concluded, that it's not possible to retain correctness with unaligned checkpointing enabled, at least not with the current design where we flush on receiving the checkpoint barrier. We would need a different design where we only finish writing when the checkpoint completes, allowing any buffered records in unaligned checkpoints to get included. This is a substantial change we cannot make in time for this release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org