You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink CDC Issue Import (Jira)" <ji...@apache.org> on 2024/03/20 09:23:00 UTC
[jira] [Commented] (FLINK-34798) [Bug] flink cdc mysql, use datastream to synchronize multiple tables, read full amount of data in a loop
[ https://issues.apache.org/jira/browse/FLINK-34798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828745#comment-17828745 ]
Flink CDC Issue Import commented on FLINK-34798:
------------------------------------------------
Date: Tue Jul 11 12:58:26 CST 2023, Author: [JNSimba|https://github.com/JNSimba]
> @JNSimba Maybe you can review this PR ([#2096|https://github.com/apache/flink-cdc/issues/2096] | [FLINK-2096|https://issues.apache.org/jira/browse/FLINK-2096])
@gong Thank you, this PR seems to happen when the task is restarted.
But my phenomenon is that the task did not restart during the first and second full synchronization, and no error was reported.
> [Bug] flink cdc mysql, use datastream to synchronize multiple tables, read full amount of data in a loop
> --------------------------------------------------------------------------------------------------------
>
> Key: FLINK-34798
> URL: https://issues.apache.org/jira/browse/FLINK-34798
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Reporter: Flink CDC Issue Import
> Priority: Major
> Labels: github-import
>
> ### Search before asking
> - [X] I searched in the [issues|https://github.com/ververica/flink-cdc-connectors/issues] and found nothing similar.
> ### Flink version
> 1.16
> ### Flink CDC version
> 2.4.0
> ### Database and its version
> mysql 8
> ### Minimal reproduce step
> Occasionally, when using the flinkcdc datastream api to synchronize MySQL multi-table data, after the full phase is read, the increment will not start, and the full read will continue in a loop.
> No restarts or failures while the task is running
> ### What did you expect to see?
> After the full amount is read, incremental reading is performed
> ### What did you see instead?
> After reading in full, continue to read in full
> ### Anything else?
> _No response_
> ### Are you willing to submit a PR?
> - [ ] I'm willing to submit a PR!
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/apache/flink-cdc/issues/2286
> Created by: [JNSimba|https://github.com/JNSimba]
> Labels: bug,
> Created at: Tue Jul 11 11:16:26 CST 2023
> State: open
--
This message was sent by Atlassian Jira
(v8.20.10#820010)