You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Matthias J. Sax (JIRA)" <ji...@apache.org> on 2018/05/15 22:11:00 UTC

[jira] [Created] (KAFKA-6906) Kafka Streams does not commit transactions if data is produced via wall-clock punctuation

Matthias J. Sax created KAFKA-6906:
--------------------------------------

             Summary: Kafka Streams does not commit transactions if data is produced via wall-clock punctuation
                 Key: KAFKA-6906
                 URL: https://issues.apache.org/jira/browse/KAFKA-6906
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 1.1.0
            Reporter: Matthias J. Sax


Committing in Kafka Streams happens in regular intervals. However, committing only happens if new input records got processed since the last commit (via setting flag `commitOffsetNeeded` within `StreamTask#process()`)

However, data could also be emitted via wall-clock based punctuation calls. Especially if EOS is enabled, this is an issue (maybe also for non-EOS) because the current running transaction is not committed and thus might time out leading to a fatal error.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)