You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Leonard Xu (Jira)" <ji...@apache.org> on 2024/10/09 12:34:00 UTC

[jira] [Assigned] (FLINK-36452) Avoid EOFException when reading binlog after a large table has just completed snapshot reading

     [ https://issues.apache.org/jira/browse/FLINK-36452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Leonard Xu reassigned FLINK-36452:
----------------------------------

    Assignee: LvYanquan

> Avoid EOFException when reading binlog after a large table has just completed snapshot reading
> ----------------------------------------------------------------------------------------------
>
>                 Key: FLINK-36452
>                 URL: https://issues.apache.org/jira/browse/FLINK-36452
>             Project: Flink
>          Issue Type: Improvement
>          Components: Flink CDC
>    Affects Versions: cdc-3.3.0
>            Reporter: LvYanquan
>            Assignee: LvYanquan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: cdc-3.3.0
>
>
> When reading binlog after a large table has just completed snapshot reading, we will need to compare the binlog position with All previous chunks to determine if this data has been processed before. However, this process is quite time-consuming and may lead to EOFException of binlog client.
> We should try to shorten the comparison time as much as possible.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)