You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "A. Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2021/02/02 20:07:00 UTC

[jira] [Updated] (KAFKA-10362) When resuming Streams active task with EOS, the checkpoint file should be deleted

     [ https://issues.apache.org/jira/browse/KAFKA-10362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

A. Sophie Blee-Goldman updated KAFKA-10362:
-------------------------------------------
    Fix Version/s: 2.6.2

> When resuming Streams active task with EOS, the checkpoint file should be deleted
> ---------------------------------------------------------------------------------
>
>                 Key: KAFKA-10362
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10362
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 2.6.0
>            Reporter: Guozhang Wang
>            Assignee: Sharath Bhat
>            Priority: Major
>              Labels: newbie++
>             Fix For: 2.7.0, 2.6.2
>
>
> Today when we suspend a task we commit and along with the commit we always write checkpoint file even if we are eosEnabled (since the state is already SUSPENDED). But the suspended task may later be resumed and in that case the checkpoint file should be deleted since it should only be written when it is cleanly closed.
> With our latest rebalance protocol in KIP-429, resume would not be called since all suspended tasks would be closed, but with the old eager protocol it may still be called — I think that may be the reason we did not get it often.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)