You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "A. Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2021/05/01 01:47:00 UTC
[jira] [Created] (KAFKA-12742) 5. Checkpoint all uncorrupted state
stores within the subtopology
A. Sophie Blee-Goldman created KAFKA-12742:
----------------------------------------------
Summary: 5. Checkpoint all uncorrupted state stores within the subtopology
Key: KAFKA-12742
URL: https://issues.apache.org/jira/browse/KAFKA-12742
Project: Kafka
Issue Type: Sub-task
Components: streams
Reporter: A. Sophie Blee-Goldman
Once we have [KAFKA-12740|https://issues.apache.org/jira/browse/KAFKA-12740], we can close the loop on EOS by checkpointing not only those state stores which are attached to processors that the record has successfully passed, but also any remaining state stores further downstream in the subtopology that aren't connected to the processor where the error occurred.
At this point, outside of a hard crash (eg process is killed) or dropping out of the group, we’ll only ever need to restore state stores from scratch if the exception came from the specific processor node they’re attached to. Which is pretty darn cool
--
This message was sent by Atlassian Jira
(v8.3.4#803005)