[jira] [Commented] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned

["Lianet Magrans (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880439#comment-17880439 ] 

Lianet Magrans commented on KAFKA-16623:
----------------------------------------

[~kirktrue] I will close this one given that consumer system tests have been green regularly after the latest changes (client failures only being the ones related to quotas, tracked on https://issues.apache.org/jira/browse/KAFKA-16138 ). Thanks! 

> KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned
> -----------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-16623
>                 URL: https://issues.apache.org/jira/browse/KAFKA-16623
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients, consumer, system tests
>    Affects Versions: 3.8.0
>            Reporter: Kirk True
>            Assignee: Lianet Magrans
>            Priority: Critical
>              Labels: consumer-threading-refactor, kip-848-client-support, system-tests
>             Fix For: 4.0.0
>
>
> When running system tests for the KafkaAsyncConsumer, we occasionally see this warning:
> {noformat}
>   File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner
>     self.run()
>   File "/usr/lib/python3.7/threading.py", line 865, in run
>     self._target(*self._args, **self._kwargs)
>   File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py", line 38, in _protected_worker
>     self._worker(idx, node)
>   File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 304, in _worker
>     handler.handle_partitions_revoked(event, node, self.logger)
>   File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py", line 163, in handle_partitions_revoked
>     (tp, node.account.hostname)
> AssertionError: Topic partition TopicPartition(topic='test_topic', partition=0) cannot be revoked from worker20 as it was not previously assigned to that consumer
> {noformat}
> In test_fencing_static_consumer, there are two sets of consumers that use group instance IDs: the initial set and the "conflict" set. It appears that one of the "conflicting" consumers hijacks the partition ownership from the coordinator's perspective when the initial consumer leaves the group.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)