You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by mrooding <ad...@webresource.nl> on 2017/11/06 14:13:18 UTC
Re: Savepoints and migrating value state data types
Hi Gordon
I've been looking into creating a custom AvroSerializer without Kryo which
would support Avro schemas and I'm starting to wonder if this is actually
the most straightforward way to do it.
If I extend a class from TypeSerializer I would also need to implement a
TypeInformation class to be able to provide my serializer. Implementing all
these classes seems to be quite the ordeal without proper documentation. Are
you sure that this is the right way forward and that there's no other option
of using Avro serialization with schema support for Flink?
Thanks again
Marc
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Savepoints and migrating value state data types
Posted by Aljoscha Krettek <al...@apache.org>.
Actually, Flink 1.4 will come with improved Avro support. See especially:
- https://issues.apache.org/jira/browse/FLINK-7420: <https://issues.apache.org/jira/browse/FLINK-7420:> Move All Avro Code to flink-avro
- https://issues.apache.org/jira/browse/FLINK-7997: <https://issues.apache.org/jira/browse/FLINK-7997:> Avro should be always in the user code
- https://issues.apache.org/jira/browse/FLINK-6022: <https://issues.apache.org/jira/browse/FLINK-6022:> Improve support for Avro GenericRecord
This makes AvroTypeInfo and AvroSerializer quite usable.
> On 6. Nov 2017, at 15:13, mrooding <ad...@webresource.nl> wrote:
>
> Hi Gordon
>
> I've been looking into creating a custom AvroSerializer without Kryo which
> would support Avro schemas and I'm starting to wonder if this is actually
> the most straightforward way to do it.
>
> If I extend a class from TypeSerializer I would also need to implement a
> TypeInformation class to be able to provide my serializer. Implementing all
> these classes seems to be quite the ordeal without proper documentation. Are
> you sure that this is the right way forward and that there's no other option
> of using Avro serialization with schema support for Flink?
>
> Thanks again
>
> Marc
>
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/