You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "li xiangyuan (Jira)" <ji...@apache.org> on 2023/07/12 10:24:00 UTC
[jira] [Updated] (KAFKA-15170) CooperativeStickyAssignor cannot adjust assignment correctly
[ https://issues.apache.org/jira/browse/KAFKA-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
li xiangyuan updated KAFKA-15170:
---------------------------------
Description:
AbstractStickyAssignor use ConstrainedAssignmentBuilder to build assignment when all consumers in group subscribe the same topic list, but it couldn't add all partitions move owner to another consumer to ``partitionsWithMultiplePreviousOwners``.
the reason is in function assignOwnedPartitions hasn't add partitions that rack-mismatch with prev owner to allRevokedPartitions, then partition only in this list would add to partitionsWithMultiplePreviousOwners.
In Cooperative Rebalance, partitions have changed owner must be removed from final assignment or will lead to incorrect consume behavior, I have already raise a pr, please take a look, thx
[https://github.com/apache/kafka/pull/13965]
was:
AbstractStickyAssignor use ConstrainedAssignmentBuilder to build assignment when all consumers in group subscribe the same topic list, but it couldn't add all partitions move owner to another consumer to ``partitionsWithMultiplePreviousOwners``.
the reason is in function assignOwnedPartitions hasn't add partitions that rack-mismatch with prev owner to allRevokedPartitions, then partition only in this list would add to partitionsWithMultiplePreviousOwners.
In Cooperative Rebalance, partitions have changed owner must be removed from final assignment or will lead to incorrect consume behavior, I have already raise a pr, please take a look, thx
https://github.com/apache/kafka/pull/13965
> CooperativeStickyAssignor cannot adjust assignment correctly
> ------------------------------------------------------------
>
> Key: KAFKA-15170
> URL: https://issues.apache.org/jira/browse/KAFKA-15170
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 3.5.0
> Reporter: li xiangyuan
> Assignee: li xiangyuan
> Priority: Major
>
> AbstractStickyAssignor use ConstrainedAssignmentBuilder to build assignment when all consumers in group subscribe the same topic list, but it couldn't add all partitions move owner to another consumer to ``partitionsWithMultiplePreviousOwners``.
>
> the reason is in function assignOwnedPartitions hasn't add partitions that rack-mismatch with prev owner to allRevokedPartitions, then partition only in this list would add to partitionsWithMultiplePreviousOwners.
>
> In Cooperative Rebalance, partitions have changed owner must be removed from final assignment or will lead to incorrect consume behavior, I have already raise a pr, please take a look, thx
>
> [https://github.com/apache/kafka/pull/13965]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)