You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Kevin Wu (Jira)" <ji...@apache.org> on 2024/10/07 19:36:00 UTC

[jira] [Updated] (KAFKA-17713) Ensure snapshots are aligned to batch boundaries

     [ https://issues.apache.org/jira/browse/KAFKA-17713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kevin Wu updated KAFKA-17713:
-----------------------------
    Reviewer: David Arthur  (was: Kevin Wu)

> Ensure snapshots are aligned to batch boundaries
> ------------------------------------------------
>
>                 Key: KAFKA-17713
>                 URL: https://issues.apache.org/jira/browse/KAFKA-17713
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Kevin Wu
>            Priority: Major
>
> In the case of a metadata transaction that is started in the middle of the record batch, the records preceding the BeginTransactionRecord in the batch are flushed. This means the SnapshotGenerator can emit a snapshot whose fetch offset (lastContainedOffset + 1) "X" is not aligned to a batch boundary. This can result in followers/observers that fetch and apply this bad snapshot to be unable to successfully fetch thereafter since the follower will reject the fetched record batch that contains offset X (starting at offset X - M), since X - M < X.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)