[jira] [Created] (FLINK-11333) First-class support for Protobuf types with evolvable schema

["Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org>]

Tzu-Li (Gordon) Tai created FLINK-11333:
-------------------------------------------

             Summary: First-class support for Protobuf types with evolvable schema
                 Key: FLINK-11333
                 URL: https://issues.apache.org/jira/browse/FLINK-11333
             Project: Flink
          Issue Type: Sub-task
          Components: Type Serialization System
            Reporter: Tzu-Li (Gordon) Tai


I think we have more and more users who are thinking about using Protobuf for their state types.
Right now, Protobuf isn't supported directly in Flink. The only way to use Protobuf for a type is to register it via Kryo: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/custom_serializers.html.

Likewise for Avro types, we should be able to natively support Protobuf, having a {{ProtobufSerializer}} that handles serialization of Protobuf types. The serializer should also write necessary information in its snapshot, to enable schema evolution for it in the future. For Protobuf, this should almost work out-of-the-box.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)