You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/03/04 08:44:00 UTC
[jira] [Commented] (KAFKA-9561) Update task input partitions when
topic metadata changes
[ https://issues.apache.org/jira/browse/KAFKA-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050998#comment-17050998 ]
ASF GitHub Bot commented on KAFKA-9561:
---------------------------------------
avalsa commented on pull request #8221: KAFKA-9561: update task input partitions after rebalance
URL: https://github.com/apache/kafka/pull/8221
*update input partitions of task and topology when rebalance occured*
*Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.*
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Update task input partitions when topic metadata changes
> --------------------------------------------------------
>
> Key: KAFKA-9561
> URL: https://issues.apache.org/jira/browse/KAFKA-9561
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Boyang Chen
> Assignee: Stepanenko Vyacheslav
> Priority: Major
> Labels: beginner, newbie, stream
>
> With https://issues.apache.org/jira/browse/KAFKA-9545, we exposed a possibility that a task could have been alive throughout the rebalance, while the input partitions actually change. For example, a regex subscribed source could have different topics when partitions are added/removed. We need to consider adding the support to expand/shrink the partitions across rebalance to keep task information consistent with subscription data.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)