You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Todd Palino (JIRA)" <ji...@apache.org> on 2018/02/13 18:48:00 UTC
[jira] [Created] (KAFKA-6559) Iterate record sets before calling
Log.append
Todd Palino created KAFKA-6559:
----------------------------------
Summary: Iterate record sets before calling Log.append
Key: KAFKA-6559
URL: https://issues.apache.org/jira/browse/KAFKA-6559
Project: Kafka
Issue Type: Improvement
Components: core
Affects Versions: 1.0.0
Reporter: Todd Palino
Assignee: Todd Palino
If a Produce request contains multiple record sets for a single topic-partition, it is better to iterate these before calling Log.append. This is because append will process all the sets together, and therefore will need to reassign offsets even if the offsets for an individual record set are properly formed. By iterating the record sets before calling append, each set can be considered on its own and potentially be appended without reassigning offsets.
While the core Java producer client does not current operate this way, it is permitted by the protocol and may be used by other clients that aggregate multiple batches together to produce them.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)