You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Magnus Reftel (JIRA)" <ji...@apache.org> on 2017/06/06 12:19:18 UTC

[jira] [Created] (KAFKA-5390) First records in batch rejected but others accepted when rolling log

Magnus Reftel created KAFKA-5390:
------------------------------------

             Summary: First records in batch rejected but others accepted when rolling log
                 Key: KAFKA-5390
                 URL: https://issues.apache.org/jira/browse/KAFKA-5390
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.10.2.1
            Reporter: Magnus Reftel
         Attachments: kafka-sequence.tar.gz

When sending a sequence of records in a batch right when the broker needs to roll a new segment, it's possible for the first few records to fail, while other records in the batch are accepted. If records have dependencies on earlier records, e.g. in the case of a sequence of events in an event-sourced system, then a producer cannot use the batching functionality, since it then risks consumers receiving a record without first receiving the records it depends on.
See attached testcase (kafka-sequence.tar.gz).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)