You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Guozhang Wang (Jira)" <ji...@apache.org> on 2020/08/05 04:19:00 UTC

[jira] [Created] (KAFKA-10362) When resuming Streams active task with EOS, the checkpoint file should be deleted

Guozhang Wang created KAFKA-10362:
-------------------------------------

             Summary: When resuming Streams active task with EOS, the checkpoint file should be deleted
                 Key: KAFKA-10362
                 URL: https://issues.apache.org/jira/browse/KAFKA-10362
             Project: Kafka
          Issue Type: Bug
          Components: streams
            Reporter: Guozhang Wang


Today when we suspend a task we commit and along with the commit we always write checkpoint file even if we are eosEnabled (since the state is already SUSPENDED). But the suspended task may later be resumed and in that case the checkpoint file should be deleted since it should only be written when it is cleanly closed.

With our latest rebalance protocol in KIP-429, resume would not be called since all suspended tasks would be closed, but with the old eager protocol it may still be called — I think that may be the reason we did not get it often.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)