You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/02/15 21:50:00 UTC

[jira] [Commented] (FLINK-8516) Allow custom shard-to-subtask assignment for the FlinkKinesisConsumer

    [ https://issues.apache.org/jira/browse/FLINK-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366303#comment-16366303 ] 

ASF GitHub Bot commented on FLINK-8516:
---------------------------------------

Github user tweise commented on the issue:

    https://github.com/apache/flink/pull/5393
  
    @tzulitai thanks for the review!


> Allow custom shard-to-subtask assignment for the FlinkKinesisConsumer
> ---------------------------------------------------------------------
>
>                 Key: FLINK-8516
>                 URL: https://issues.apache.org/jira/browse/FLINK-8516
>             Project: Flink
>          Issue Type: New Feature
>          Components: Kinesis Connector
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Major
>             Fix For: 1.5.0
>
>
> The hash code of the shard is used to distribute discovered shards over subtasks round robin. This works as long as shard identifiers are sequential. After shards are rebalanced in Kinesis, that may no longer be the case and the distribution become skewed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)