You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nicolas Ferrario (Jira)" <ji...@apache.org> on 2021/10/31 14:55:00 UTC

[jira] [Commented] (FLINK-21409) Add Avro to DataTypes & Serialization docs

    [ https://issues.apache.org/jira/browse/FLINK-21409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17436496#comment-17436496 ] 

Nicolas Ferrario commented on FLINK-21409:
------------------------------------------

I think this is important. We learned the hard way that serializing a GenericRecord using TypeInformation.of actually falls back to Kryo. It used to work up to Flink 1.12, but we started getting (useful) errors in 1.13, probably also because Avro was bumped up from 1.8 to 1.10.

Having docs would definitely help newcomers

> Add Avro to DataTypes & Serialization docs
> ------------------------------------------
>
>                 Key: FLINK-21409
>                 URL: https://issues.apache.org/jira/browse/FLINK-21409
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / Type Serialization System, Documentation, Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>            Reporter: Chesnay Schepler
>            Priority: Minor
>              Labels: auto-deprioritized-major
>             Fix For: 1.15.0
>
>
> The "Data Types & Serialization" barely mention Avro, which is surprising given how common it is.
> Even basic things like how to create a correct TypeInformation for GenericRecords is missing, or special cases like FLINK-21386 which likely just won't work.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)