You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jason Gustafson (Jira)" <ji...@apache.org> on 2020/11/02 23:08:00 UTC

[jira] [Resolved] (KAFKA-10632) Raft client should push all committed data to listeners

     [ https://issues.apache.org/jira/browse/KAFKA-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Gustafson resolved KAFKA-10632.
-------------------------------------
    Resolution: Fixed

> Raft client should push all committed data to listeners
> -------------------------------------------------------
>
>                 Key: KAFKA-10632
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10632
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Jason Gustafson
>            Assignee: Jason Gustafson
>            Priority: Major
>
> We would like to move to a push model for sending committed data to the state machine. This simplifies the state machine a bit since it does not need to track its own position and poll for new data. It also allows the raft layer to ensure that all committed data up to the state of a leader epoch has been sent before allowing the state machine to begin sending writes. Finally, it allows us to take advantage of optimizations. For example, we can save the need to re-read writes that have been sent to the leader; instead, we can retain the data in memory and push it to the state machine after it becomes committed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)