You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "gongzexin (via GitHub)" <gi...@apache.org> on 2025/02/13 10:24:29 UTC
[PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]
gongzexin opened a new pull request, #3920:
URL: https://github.com/apache/flink-cdc/pull/3920
This closes [FLINK-37313](https://issues.apache.org/jira/browse/FLINK-37313).
# SnapshotSplitReader#isBackfillRequired
If the binlog has not changed during the snapshot split read, the binlog should not be read.
# MySqlStreamingChangeEventSource#handleChange
Even if you read the binlog of a table you don't care about, you should update the timestamp to avoid MySqlBinlogSplitReadTask#handleEvent reading a large amount of binlog
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]
Posted by "lvyanquan (via GitHub)" <gi...@apache.org>.
lvyanquan commented on PR #3920:
URL: https://github.com/apache/flink-cdc/pull/3920#issuecomment-2667375370
Hi, @gongzexin.
I think that the problem that you met was resolved in https://github.com/apache/flink-cdc/pull/3902 as https://github.com/apache/flink-cdc/pull/3902#issuecomment-2639121416 describes, can you check for this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]
Posted by "gongzexin (via GitHub)" <gi...@apache.org>.
gongzexin commented on PR #3920:
URL: https://github.com/apache/flink-cdc/pull/3920#issuecomment-2673182080
> Hi, @gongzexin.
>
> I think that the problem that you met was resolved in #3902 as [#3902 (comment)](https://github.com/apache/flink-cdc/pull/3902#issuecomment-2639121416) describes, can you check for this?
Hi,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process [flink-cdc]
Posted by "gongzexin (via GitHub)" <gi...@apache.org>.
gongzexin closed pull request #3920: [FLINK-37313] Fix the problem of reading binlog before the high and low watermarks during the snapshot process
URL: https://github.com/apache/flink-cdc/pull/3920
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org