You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Boyang Chen (Jira)" <ji...@apache.org> on 2020/05/26 00:39:00 UTC

[jira] [Updated] (KAFKA-9561) Update task input partitions when topic metadata changes

     [ https://issues.apache.org/jira/browse/KAFKA-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boyang Chen updated KAFKA-9561:
-------------------------------
    Fix Version/s: 2.6.0

> Update task input partitions when topic metadata changes
> --------------------------------------------------------
>
>                 Key: KAFKA-9561
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9561
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Boyang Chen
>            Assignee: Stepanenko Vyacheslav
>            Priority: Major
>              Labels: beginner, newbie, stream
>             Fix For: 2.6.0
>
>
> With https://issues.apache.org/jira/browse/KAFKA-9545, we exposed a possibility that a task could have been alive throughout the rebalance, while the input partitions actually change. For example, a regex subscribed source could have different topics when partitions are added/removed. We need to consider adding the support to expand/shrink the partitions across rebalance to keep task information consistent with subscription data.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)