You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Vicky Papavasileiou (Jira)" <ji...@apache.org> on 2022/10/12 16:19:00 UTC

[jira] [Created] (KAFKA-14294) Kafka Streams should commit transaction even no records are processed

Vicky Papavasileiou created KAFKA-14294:
-------------------------------------------

             Summary: Kafka Streams should commit transaction even no records are processed
                 Key: KAFKA-14294
                 URL: https://issues.apache.org/jira/browse/KAFKA-14294
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Vicky Papavasileiou


Currently, if there are no records to process in the input topic, a transaction does not commit. If a custom punctuator code is writing to a state store (which is common practice) the producer gets fenced when trying to write to the changelog topic. This throws a TaskMigratedException and causes a rebalance. 

A better approach would be to commit a transaction even when there are no records processed as to allow the punctuator to make progress. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)