[jira] [Created] (FLINK-37837) Always Add create.table to include.schema.changes option

["Yanquan Lv (Jira)" <ji...@apache.org>]

Yanquan Lv created FLINK-37837:
----------------------------------

             Summary: Always Add create.table to include.schema.changes option
                 Key: FLINK-37837
                 URL: https://issues.apache.org/jira/browse/FLINK-37837
             Project: Flink
          Issue Type: Improvement
          Components: Flink CDC
    Affects Versions: cdc-3.4.0
            Reporter: Yanquan Lv


`[include.schema.changes|https://nightlies.apache.org/flink/flink-cdc-docs-master/docs/core-concept/schema-evolution/#options]` indicate the support SchemaChange types of pipeline.

Sometime user may only want to catch and process AddColumnEvent in their job, and the config of their yaml file may be written like:
sink:
  type: starrocks
  ......
  include.schema.changes: [add.column] 


However, this job will meet the following exception because CreateTableEvent was ignored:

Caused by: java.lang.IllegalStateException: Unable to coerce data record from third_data.table (schema: ......) to ods_test.route_table (schema: null)
at org.apache.flink.cdc.runtime.operators.schema.regular.SchemaOperator.lambda$handleDataChangeEvent$1(SchemaOperator.java:214) ~[?:?]

I believe that CreateTableEvent is the foundation for all our subsequent processing, so we should always add it to supported schema change types.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)