You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink CDC Issue Import (Jira)" <ji...@apache.org> on 2024/03/20 09:22:00 UTC

[jira] [Commented] (FLINK-34794) [Bug] if splitTable method execute fast than getNext, job will be blocked

    [ https://issues.apache.org/jira/browse/FLINK-34794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828719#comment-17828719 ] 

Flink CDC Issue Import commented on FLINK-34794:
------------------------------------------------

Date: Wed Jun 07 11:43:04 CST 2023, Author: [y0908105023|https://github.com/y0908105023]

the below jpg is job's stack, job will waiting forever, cannot handle data and throw exception
![image|https://github.com/ververica/flink-cdc-connectors/assets/8789291/0c04cc86-ff68-45f6-a84b-7aa927532fe2]


> [Bug] if splitTable method execute fast than getNext, job will be blocked
> -------------------------------------------------------------------------
>
>                 Key: FLINK-34794
>                 URL: https://issues.apache.org/jira/browse/FLINK-34794
>             Project: Flink
>          Issue Type: Bug
>          Components: Flink CDC
>            Reporter: Flink CDC Issue Import
>            Priority: Major
>              Labels: github-import
>
> ### Search before asking
> - [X] I searched in the [issues|https://github.com/ververica/flink-cdc-connectors/issues) and found nothing similar.
> ### Flink version
> [e49e22065fdd6f1026db76f81bd8ed38e81ef173|https://github.com/apache/flink-cdc/commit/e49e22065fdd6f1026db76f81bd8ed38e81ef173]
> ### Flink CDC version
> [e49e22065fdd6f1026db76f81bd8ed38e81ef173|https://github.com/apache/flink-cdc/commit/e49e22065fdd6f1026db76f81bd8ed38e81ef173]
> ### Database and its version
> mysql:  mysql 8.0.27
> ### Minimal reproduce step
> add `Thread.sleep(10000)` before MySqlSnapshotSplitAssigner.getNext().  lock.wait will not be notify any more, and it will wait forever.
> ### What did you expect to see?
> job can execute normally
> ### What did you see instead?
> nothing
> ### Anything else?
> On MysqlCDC job start,  the method splitTable() &&  getNext(] from MySqlSnapshotSplitAssigner will be execute asynchronously, the two method use one lock, and depend on the order of execution。Under special circumstances,  the job does not perform as expected
> ### Are you willing to submit a PR?
> - [x] I'm willing to submit a PR!
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/apache/flink-cdc/issues/2187
> Created by: [y0908105023|https://github.com/y0908105023]
> Labels: bug, 
> Assignee: [y0908105023|https://github.com/y0908105023]
> Created at: Wed Jun 07 11:37:46 CST 2023
> State: open



--
This message was sent by Atlassian Jira
(v8.20.10#820010)