You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "yuxiqian (via GitHub)" <gi...@apache.org> on 2024/08/02 09:52:05 UTC
[PR] [tests][cdc-connectors][mongo] Fix unstable test cases for snapshot back-filling [flink-cdc]
yuxiqian opened a new pull request, #3506:
URL: https://github.com/apache/flink-cdc/pull/3506
This fixes a rarely happened failure case, observed in https://github.com/apache/flink-cdc/actions/runs/10209766277/job/28253831363?pr=3388 by @loserwang1024.
`testSnapshotOnlyModeWithDMLPreHighWaterMark` case will fail, if there's no operation or heartbeat events between event #a (the ChangeStream opLog caused by the last event in this hook) and event #b (the calculated high watermark that limits the bounded back-filling stream fetch task), the last event of hook will be missed since back-filling task only reads data between [loW, hiW) (high watermark not included).
This is a workaround by insert a dummy event in another collection to forcefully push opLog forward, so #a will not be the same as the high watermark #b.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [tests][cdc-connectors][mongo] Fix unstable test cases for snapshot back-filling [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian commented on PR #3506:
URL: https://github.com/apache/flink-cdc/pull/3506#issuecomment-2265007350
Could @Jiabao-Sun @loserwang1024 please take a look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot back-filling [flink-cdc]
Posted by "Jiabao-Sun (via GitHub)" <gi...@apache.org>.
Jiabao-Sun merged PR #3506:
URL: https://github.com/apache/flink-cdc/pull/3506
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org