You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Boyang Chen (Jira)" <ji...@apache.org> on 2020/02/15 00:46:00 UTC

[jira] [Created] (KAFKA-9561) Update task input partitions when topic metadata changes

Boyang Chen created KAFKA-9561:
----------------------------------

             Summary: Update task input partitions when topic metadata changes
                 Key: KAFKA-9561
                 URL: https://issues.apache.org/jira/browse/KAFKA-9561
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Boyang Chen


With https://issues.apache.org/jira/browse/KAFKA-9545, we exposed a possibility that a task could have been alive throughout the rebalance, while the input partitions actually change. For example, a regex subscribed source could have different topics when partitions are added/removed. We need to consider adding the support to expand/shrink the partitions across rebalance to keep task information consistent with subscription data.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)