You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Thomas Weise (JIRA)" <ji...@apache.org> on 2018/01/26 04:27:03 UTC
[jira] [Created] (FLINK-8516) FlinkKinesisConsumer does not balance
shards over subtasks
Thomas Weise created FLINK-8516:
-----------------------------------
Summary: FlinkKinesisConsumer does not balance shards over subtasks
Key: FLINK-8516
URL: https://issues.apache.org/jira/browse/FLINK-8516
Project: Flink
Issue Type: Bug
Components: Kinesis Connector
Reporter: Thomas Weise
The hash code of the shard is used to distribute discovered shards over subtasks round robin. This works as long as shard identifiers are sequential. After shards are rebalanced in Kinesis, that may no longer be the case and the distribution become skewed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)