You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Daniyar Yeralin (Jira)" <ji...@apache.org> on 2021/05/04 21:18:00 UTC

[jira] [Updated] (KAFKA-8326) Add Serde> support

     [ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniyar Yeralin updated KAFKA-8326:
-----------------------------------
    Description: 
_This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and {color:#4c9aff}ListDeserializer{color} classes as well as support for the new classes into the Serdes class. This will allow using List Serde of type_ {color:#4c9aff}_Serde<List<Inner>>_{color} _directly from Consumers, Producers and Streams._

_{color:#4c9aff}Serde<List<Inner>>{color} serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic {color:#4c9aff}Inner{color}'s Serde. For example, if you want to create List of Strings serde, then serializer/deserializer of StringSerde will be used to serialize/deserialize each entry in {color:#4c9aff}List<String>{color}._

I believe there are many use cases where List Serde could be used:
 * [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows]
 * [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]

For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection.

KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]

  was:
_This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and {color:#4c9aff}ListDeserializer{color} classes as well as support for the new classes into the Serdes class. This will allow using List Serde of type_ {color:#4c9aff}_Serde<List<Inner>>_{color} _directly from Consumers, Producers and Streams._

_{color:#4c9aff}Serde<List<Inner>>{color} serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic {color:#4c9aff}Inner{color}'s Serde. For example, if you want to create List of Strings serde, then serializer/deserializer of StringSerde will be used to serialize/deserialize each entry in {color:#4c9aff}List<String>{color}._

I believe there are many use cases where List Serde could be used. Ex. [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows], [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]

For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection.

KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]


> Add Serde<List<Inner>> support
> ------------------------------
>
>                 Key: KAFKA-8326
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8326
>             Project: Kafka
>          Issue Type: Improvement
>          Components: clients, streams
>            Reporter: Daniyar Yeralin
>            Assignee: Daniyar Yeralin
>            Priority: Minor
>              Labels: kip
>
> _This ticket proposes adding new {color:#4c9aff}ListSerializer{color} and {color:#4c9aff}ListDeserializer{color} classes as well as support for the new classes into the Serdes class. This will allow using List Serde of type_ {color:#4c9aff}_Serde<List<Inner>>_{color} _directly from Consumers, Producers and Streams._
> _{color:#4c9aff}Serde<List<Inner>>{color} serialization and deserialization will be done through repeatedly calling a serializer/deserializer for each entry provided by passed generic {color:#4c9aff}Inner{color}'s Serde. For example, if you want to create List of Strings serde, then serializer/deserializer of StringSerde will be used to serialize/deserialize each entry in {color:#4c9aff}List<String>{color}._
> I believe there are many use cases where List Serde could be used:
>  * [https://stackoverflow.com/questions/41427174/aggregate-java-objects-in-a-list-with-kafka-streams-dsl-windows]
>  * [https://stackoverflow.com/questions/46365884/issue-with-arraylist-serde-in-kafka-streams-api]
> For instance, aggregate grouped (by key) values together in a list to do other subsequent operations on the collection.
> KIP Link: [https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3A+Add+support+for+List%3CT%3E+serialization+and+deserialization]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)