You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tongkai Yin (Jira)" <ji...@apache.org> on 2024/05/16 09:59:00 UTC
[jira] [Commented] (FLINK-35377) debezium-json support soft deletion.
[ https://issues.apache.org/jira/browse/FLINK-35377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846893#comment-17846893 ]
Tongkai Yin commented on FLINK-35377:
-------------------------------------
{code:java}
//代码占位符
set 'execution.checkpointing.interval'='10s';
SET sql-client.execution.result-mode=tableau;
CREATE TABLE user_scores1
(
`id` INT,
`uid` INT,
`score` INT
) WITH (
'connector' = 'kafka',
'topic' = 'topic_user_scores',
'properties.bootstrap.servers' = 'hdp04:6667',
'properties.group.id' = 'user_scores',
'scan.startup.mode' = 'earliest-offset',
'format' = 'debezium-json'
);
select * from user_scores1;{code}
!20240516175523.jpg|width=693,height=296!
{code:java}
//代码占位符
set 'execution.checkpointing.interval'='10s';
SET sql-client.execution.result-mode=tableau;
CREATE TABLE user_scores
(
`id` INT,
`uid` INT,
`score` INT,
`is_delete` INT
) WITH (
'connector' = 'kafka',
'topic' = 'topic_user_scores',
'properties.bootstrap.servers' = 'hdp04:6667',
'properties.group.id' = 'user_scores',
'scan.startup.mode' = 'earliest-offset',
'format' = 'debezium-json',
'debezium-json.enable-soft-delete' = 'true',
'debezium-json.delete-field-name' = 'is_delete'
);
select * from user_scores;{code}
!20240516175543.jpg|width=704,height=281!
> debezium-json support soft deletion.
> ------------------------------------
>
> Key: FLINK-35377
> URL: https://issues.apache.org/jira/browse/FLINK-35377
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: Tongkai Yin
> Priority: Minor
> Attachments: 20240516175523.jpg, 20240516175543.jpg
>
>
> When we use kafka to do some real-time synchronization tasks, sometimes our business scenarios need to use soft delete instead of hard delete. Our data is more connected to kafka, so we want debezium-json to support soft deletion.Based on this, we modified the flink-json module.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)