You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Matthias J. Sax (JIRA)" <ji...@apache.org> on 2018/05/15 22:11:00 UTC
[jira] [Created] (KAFKA-6906) Kafka Streams does not commit
transactions if data is produced via wall-clock punctuation
Matthias J. Sax created KAFKA-6906:
--------------------------------------
Summary: Kafka Streams does not commit transactions if data is produced via wall-clock punctuation
Key: KAFKA-6906
URL: https://issues.apache.org/jira/browse/KAFKA-6906
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 1.1.0
Reporter: Matthias J. Sax
Committing in Kafka Streams happens in regular intervals. However, committing only happens if new input records got processed since the last commit (via setting flag `commitOffsetNeeded` within `StreamTask#process()`)
However, data could also be emitted via wall-clock based punctuation calls. Especially if EOS is enabled, this is an issue (maybe also for non-EOS) because the current running transaction is not committed and thus might time out leading to a fatal error.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)