[jira] [Created] (FLINK-36347) Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics.

["Zhongmin Qiao (Jira)" <ji...@apache.org>]

Zhongmin Qiao created FLINK-36347:
-------------------------------------

             Summary: Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics.
                 Key: FLINK-36347
                 URL: https://issues.apache.org/jira/browse/FLINK-36347
             Project: Flink
          Issue Type: Bug
          Components: Flink CDC
    Affects Versions: cdc-3.2.0
            Reporter: Zhongmin Qiao
             Fix For: cdc-3.2.1
         Attachments: image-2024-09-22-16-51-09-930.png

!image-2024-09-22-16-51-09-930.png!

Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics because "show master status" and the query action are not in the same transaction. There may be data inserted between the query action and the retrieval of the high watermark. As a result, these data will be lost since we only deliver data after the high watermark during the binlog phase.

 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)