[jira] [Created] (FLINK-36784) Support to add metadata columns for data in the meta fields of DataChangeEvent at transform

["Ruan Hang (Jira)" <ji...@apache.org>]

Ruan Hang created FLINK-36784:
---------------------------------

             Summary: Support to add metadata columns for data in the meta fields of DataChangeEvent at transform
                 Key: FLINK-36784
                 URL: https://issues.apache.org/jira/browse/FLINK-36784
             Project: Flink
          Issue Type: New Feature
          Components: Flink CDC
    Affects Versions: cdc-3.2.1
            Reporter: Ruan Hang
            Assignee: Ruan Hang
             Fix For: cdc-3.3.0


Flink CDC supports to use some metadata columns in transform, which includes as follows.
||Field||Data Type||Description||
|*namespace_name*|String|Name of the namespace that contains the row.|
|*schema_name*|String|Name of the schema that contains the row.|
|*table_name*|String|Name of the table that contains the row.|
|*data_event_type*|String|Operation type of data change event.|

These metadata columns are from the tableId or op field in DataChangeEvent.

Some metadata columns are not supported in pipeline connectors, like op_ts. These metadata is stored in the meta field in DataChangeEvent.

I think we should support to add metadata columns for the meta field in DataChangeEvent.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)