You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "hailong wang (Jira)" <ji...@apache.org> on 2021/01/05 14:26:00 UTC
[jira] [Commented] (FLINK-20454) Allow to read metadata for
debezium-avro-confluent format
[ https://issues.apache.org/jira/browse/FLINK-20454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258956#comment-17258956 ]
hailong wang commented on FLINK-20454:
--------------------------------------
I want to discuss what metadata make sense for debezium-avro-confluent format.
We should use the deterministic metadata to create the avro reader schema. So maybe we cannot define `source.properties` metadata to include all properties.
So is the following metadata sufficient?
* ingestion-timestamp for ts_ms in root scope
* source.timestamp for ts_ms in source scope
* source.database for db in source scope
* source.schema for schema in source scope
* source.table for table in source scope
> Allow to read metadata for debezium-avro-confluent format
> ---------------------------------------------------------
>
> Key: FLINK-20454
> URL: https://issues.apache.org/jira/browse/FLINK-20454
> Project: Flink
> Issue Type: Sub-task
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
> Reporter: Jark Wu
> Assignee: hailong wang
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)