You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Hong Liang Teoh (Jira)" <ji...@apache.org> on 2024/08/30 08:41:00 UTC

[jira] [Created] (FLINK-36187) Reimplement UniformShardAssigner using Kinesis shard hashes

Hong Liang Teoh created FLINK-36187:
---------------------------------------

             Summary: Reimplement UniformShardAssigner using Kinesis shard hashes
                 Key: FLINK-36187
                 URL: https://issues.apache.org/jira/browse/FLINK-36187
             Project: Flink
          Issue Type: Sub-task
            Reporter: Hong Liang Teoh


Currently, the UniformShardAssigner on the new KDS source follows a RoundRobin assignment strategy. This has problems assigning shards evenly if there is a resharding operation (some shards will have less records than others).

Instead, we will use a deterministic distribution strategy that accounts for the shard hashes, which will ensure that we have a more uniform shard assignment.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)