[jira] [Created] (KAFKA-14359) Idempotent Producer continues to retry on OutOfOrderSequence error when first batch fails

["Justine Olshan (Jira)" <ji...@apache.org>]

Justine Olshan created KAFKA-14359:
--------------------------------------

             Summary: Idempotent Producer continues to retry on OutOfOrderSequence error when first batch fails
                 Key: KAFKA-14359
                 URL: https://issues.apache.org/jira/browse/KAFKA-14359
             Project: Kafka
          Issue Type: Task
            Reporter: Justine Olshan


When the idempotent producer does not have any state it can fall into a state where the producer keeps retrying an out of order sequence. Consider the following scenario where an idempotent producer has retries and delivery timeout are int max (a configuration used in streams).

1. A producer send out several batches (up to 5) with the first one starting at sequence 0.
2. The first batch with sequence 0 fails due to a transient error (ie, NOT_LEADER_OR_FOLLOWER or a timeout error)
3. The second batch, say with sequence 200 comes in. Since there is no previous state to invalidate it, it gets written to the log
4. The original batch is retried and will get an out of order sequence number
5. Current java client will continue to retry this batch, but it will never resolve. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)