You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Felix Dsouza (JIRA)" <ji...@apache.org> on 2018/04/30 09:33:00 UTC
[jira] [Created] (KAFKA-6838) Transaction timeout after punctuation
results in ProducerFencedException
Felix Dsouza created KAFKA-6838:
-----------------------------------
Summary: Transaction timeout after punctuation results in ProducerFencedException
Key: KAFKA-6838
URL: https://issues.apache.org/jira/browse/KAFKA-6838
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 1.1.0
Reporter: Felix Dsouza
Attachments: punctuat-producer-fencing-borker.log
It looks like the EOS/transaction handling for stream punctuation does not work correctly.
We have encountered ProducerFencedException in a specific case where new events do not arrive before the transaction started by punctuation times out.
Following squence of events trigger this scenario.
1. Punctuation is triggered, we delete some records from the State store (logging enabled) . A transaction is registered on the broker. txnState=Ongoing
2. There are no new events to be consumed (period of inactivity) and no new punctuation happening.
3. Broker aborts the transaction after about 60000 ms (default transaction timeout duration for the stream) , txnState=Ongoing -> txnState=PrepareAbort -> txnState=CompleteAbort
4. A new event comes in and hits producer fenced exception
Attached are the logs from the broker where a successful processing, along with transaction timeout and producer fencing is shown.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)