You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jark Wu (Jira)" <ji...@apache.org> on 2020/08/05 07:47:00 UTC

[jira] [Created] (FLINK-18824) Support serialization for canal-json format

Jark Wu created FLINK-18824:
-------------------------------

             Summary: Support serialization for canal-json format
                 Key: FLINK-18824
                 URL: https://issues.apache.org/jira/browse/FLINK-18824
             Project: Flink
          Issue Type: Sub-task
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
            Reporter: Jark Wu


Currently, canal-json format only support deserialization, but not support serialization. This is not convenient for users to writing changelogs to an message queue. 

The serialization for canal-json can follow the json strcuture of Canal, but considering currently Flink can't combine UPDATE_BEFORE and UPDATE_AFTER into a single UPDATE message. We can encode UPDATE_BEFORE and UDPATE_AFTER as DELETE and INSERT canal messages. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)