You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "yux (Jira)" <ji...@apache.org> on 2025/04/11 06:01:00 UTC
[jira] [Updated] (FLINK-37653) Incremental snapshot framework supports assigning multiple StreamSplit
[ https://issues.apache.org/jira/browse/FLINK-37653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
yux updated FLINK-37653:
------------------------
Description:
Currently, HybridSplitAssigners and StreamSplitAssigners in incremental snapshot framework implicitly assumes that there will be at most one unbounded stream split, which isn't true for some data sources that supports multi change stream, like MongoDB and PolarDB-X.
This change should extend assigners' API without changing existing data sources' behavior.
was:
Currently, HybridSplitAssigners and StreamSplitAssigners in incremental snapshot framework implicitly assumes that there will be at most one unbounded stream split, which isn't true for some data sources that supports multi change stream, like MongoDB and PolarDB.
This change should extend assigners' API without changing existing data sources' behavior.
> Incremental snapshot framework supports assigning multiple StreamSplit
> ----------------------------------------------------------------------
>
> Key: FLINK-37653
> URL: https://issues.apache.org/jira/browse/FLINK-37653
> Project: Flink
> Issue Type: Improvement
> Components: Flink CDC
> Reporter: yux
> Assignee: yux
> Priority: Minor
>
> Currently, HybridSplitAssigners and StreamSplitAssigners in incremental snapshot framework implicitly assumes that there will be at most one unbounded stream split, which isn't true for some data sources that supports multi change stream, like MongoDB and PolarDB-X.
> This change should extend assigners' API without changing existing data sources' behavior.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)