You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by HARSH TAKKAR <ta...@gmail.com> on 2020/04/28 11:46:39 UTC

Structured Streaming using Kafka Avro Record in 2.3.0

Hi

How can we deserialise avro record read from kafka in spark 2.3.0 in
optimised manner. I could see that native support for avro was added in
2.4.x.

Currently i am using following library which is very slow.

<dependency>
    <groupId>com.twitter</groupId>
    <artifactId>bijection-avro_2.11</artifactId>
</dependency>


Kind Regards
Harsh Takkar