Flatbuffers and Flink

[Basanth Gowda <ba...@gmail.com>]

Hi,
This is 1 of 3 questions I had for Flink. Didn't want to club all of them
together, as this might be useful for some one else in the future.

Do we have Flatbuffers support in Flink ? If there is no support, is there
a way to implement it ?

Trying to see if we could use the byte[] that has come from upstream,
without converting it into POJO / other format.


thank you

Re: Flatbuffers and Flink

[Fabian Hueske <fh...@gmail.com>]

Hi,

in principle you can use any data type with Flink including byte[].
However, all of your functions need the logic to interpret the bytes and
you have to implement custom key extractors (if you need to keyBy or
partition your stream).

Best, Fabian

2017-08-01 2:09 GMT+02:00 Basanth Gowda <ba...@gmail.com>:

> Hi,
> This is 1 of 3 questions I had for Flink. Didn't want to club all of them
> together, as this might be useful for some one else in the future.
>
> Do we have Flatbuffers support in Flink ? If there is no support, is there
> a way to implement it ?
>
> Trying to see if we could use the byte[] that has come from upstream,
> without converting it into POJO / other format.
>
>
> thank you
>