You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2023/02/23 08:23:00 UTC

[jira] [Created] (FLINK-31195) FullChangelogStoreSinkWrite bucket writer conflicts with rescale

Jingsong Lee created FLINK-31195:
------------------------------------

             Summary: FullChangelogStoreSinkWrite bucket writer conflicts with rescale
                 Key: FLINK-31195
                 URL: https://issues.apache.org/jira/browse/FLINK-31195
             Project: Flink
          Issue Type: Bug
          Components: Table Store
            Reporter: Jingsong Lee
             Fix For: table-store-0.4.0


At present, this operator relies on ListState, Flink distributes data according to round-robin when rescaling, which may be different from the distribution rules of our bucket after rescaling.

We need to change the mode of UnionListState, broadcast to each node, and finally decide whether it belongs to the task.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)