You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Aditya Kousik (Jira)" <ji...@apache.org> on 2026/09/17 19:31:00 UTC
[jira] [Updated] (KAFKA-21122) ByteBuffer serialize method for Serializer
[ https://issues.apache.org/jira/browse/KAFKA-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aditya Kousik updated KAFKA-21122:
----------------------------------
Summary: ByteBuffer serialize method for Serializer (was: ByteBuffer serialize method to the producer Serializer)
> ByteBuffer serialize method for Serializer
> ------------------------------------------
>
> Key: KAFKA-21122
> URL: https://issues.apache.org/jira/browse/KAFKA-21122
> Project: Kafka
> Issue Type: Improvement
> Components: clients, producer
> Reporter: Aditya Kousik
> Assignee: Aditya Kousik
> Priority: Major
> Labels: kip
>
> The consumer read path avoids a per-record copy for the record value. KIP-863 added a ByteBuffer method to Deserializer so that CompletedFetch#parseRecord can hand the deserializer the record value straight from the fetch buffer:
>
> {code:java}
> default T deserialize(String topic, Headers headers, ByteBuffer data) { ... } {code}
>
> The default falls back to the {{byte[]}} method, so existing deserializers are unaffected, and {{ByteBufferDeserializer}} overrides it to skip the copy.
> The producer has no matching method. {{Serializer}} only returns {{{}byte[]{}}}:
> {code:java}
> byte[] serialize(String topic, Headers headers, T data);{code}
> So a producer whose record value is already in a ByteBuffer has to copy it into a byte[] for every record. This is the case for a caller that holds data off the Java heap or in a reused buffer, for example a Netty ByteBuf exposed through nioBuffer(), or a service that forwards a payload it does not read.
> We should consider adding the missing method so the write side matches the read side that KIP-863 already added.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)