[jira] [Created] (KAFKA-6838) Transaction timeout after punctuation results in ProducerFencedException

["Felix Dsouza (JIRA)" <ji...@apache.org>]

Felix Dsouza created KAFKA-6838:
-----------------------------------

             Summary: Transaction timeout after punctuation results in ProducerFencedException
                 Key: KAFKA-6838
                 URL: https://issues.apache.org/jira/browse/KAFKA-6838
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 1.1.0
            Reporter: Felix Dsouza
         Attachments: punctuat-producer-fencing-borker.log

It looks like the EOS/transaction handling for stream punctuation does not work correctly.

We have encountered ProducerFencedException in a specific case where new events do not arrive before the transaction started by punctuation times out.

Following squence of events trigger this scenario.

 1. Punctuation is triggered, we delete some records from the State store (logging enabled) . A transaction is registered on the broker. txnState=Ongoing
2. There are no new events to be consumed (period of inactivity) and no new punctuation happening.
3. Broker aborts the transaction after about 60000 ms  (default transaction timeout duration for the stream) , txnState=Ongoing -> txnState=PrepareAbort  ->  txnState=CompleteAbort
4. A new event comes in and hits producer fenced exception
 
Attached are the logs from the broker where a successful processing, along with transaction timeout and producer fencing is shown.
 
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)