[jira] [Created] (FLINK-38520) Postgres YAML CDC support array with null element

["Hongshun Wang (Jira)" <ji...@apache.org>]

Hongshun Wang created FLINK-38520:
-------------------------------------

             Summary: Postgres YAML CDC support array with null element
                 Key: FLINK-38520
                 URL: https://issues.apache.org/jira/browse/FLINK-38520
             Project: Flink
          Issue Type: Improvement
          Components: Flink CDC
    Affects Versions: cdc-3.4.0
            Reporter: Hongshun Wang
             Fix For: cdc-3.6.0


Currently, if a null value in array, exception will occur:
{code:java}
java.lang.IllegalArgumentException: Unable convert multidimensional array value '[null]' to a flat array.	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToArray(DebeziumEventDeserializationSchema.java:519)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$4.convert(DebeziumEventDeserializationSchema.java:248)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertField(DebeziumEventDeserializationSchema.java:462)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToRecord(DebeziumEventDeserializationSchema.java:449)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$2.convert(DebeziumEventDeserializationSchema.java:228)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractDataRecord(DebeziumEventDeserializationSchema.java:157)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractAfterDataRecord(DebeziumEventDeserializationSchema.java:152)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserializeDataChangeRecord(DebeziumEventDeserializationSchema.java:118)	at org.apache.flink.cdc.debezium.event.SourceRecordEventDeserializer.deserialize(SourceRecordEventDeserializer.java:49)	at org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserialize(DebeziumEventDeserializationSchema.java:105)	at org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitElement(IncrementalSourceRecordEmitter.java:160)	at org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.processElement(IncrementalSourceRecordEmitter.java:118)	at org.apache.flink.cdc.connectors.postgres.source.reader.PostgresPipelineRecordEmitter.processElement(PostgresPipelineRecordEmitter.java:114)	at org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:88)	at org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:57)	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:229)	at org.apache.flink.streaming.api.operators.SourceOperator.pollNext(SourceOperator.java:806)	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:484)	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:70)	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:706) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)