Alternate Forms of Deserialization in Flink SQL CLI

[Eric Carlson <er...@doordash.com>]

Hello,

What would be the most natural way to plug in a custom deserializer or
deserialization format to the Flink SQL CLI (or to do something similar
which achieves the same effect)? There is no support for Protobuf, for
instance, and regardless it should make the CLI much more useful. It is
straightforward to deserialize messages from a Kafka topic which have been
deserialized with JSON or Avro, but trying to figure out Protobuf has taken
a minute.

Thanks!

Re: Alternate Forms of Deserialization in Flink SQL CLI

[Martijn Visser <ma...@apache.org>]

Hi Eric,

It would basically mean implementing Protobuf as is now done for AVRO or
JSON. There is a pull request on adding Protobuf support currently being
reviewed, hopefully that will make it in Flink 1.16 [1]. You could consider
trying that out of course.

Best regards,

Martijn

[1] https://github.com/apache/flink/pull/14376

Op vr 1 jul. 2022 om 21:41 schreef Eric Carlson <er...@doordash.com>:

> Hello,
>
> What would be the most natural way to plug in a custom deserializer or
> deserialization format to the Flink SQL CLI (or to do something similar
> which achieves the same effect)? There is no support for Protobuf, for
> instance, and regardless it should make the CLI much more useful. It is
> straightforward to deserialize messages from a Kafka topic which have been
> deserialized with JSON or Avro, but trying to figure out Protobuf has taken
> a minute.
>
> Thanks!
>