You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "João Pedro Fonseca (Jira)" <ji...@apache.org> on 2024/09/01 14:20:00 UTC
[jira] [Commented] (KAFKA-17233) MirrorCheckpointConnector should use batched listConsumerGroupOffsets
[ https://issues.apache.org/jira/browse/KAFKA-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878434#comment-17878434 ]
João Pedro Fonseca commented on KAFKA-17233:
--------------------------------------------
Another example:
I run gradle clean unitTest --console plain > /tmp/unitTestX.txt where X is the number of the run. I have obtained three different results:
$ grep ' FAILED' /tmp/unitTest.txt
Gradle Test Run :clients:unitTest > Gradle Test Executor 624 > AbstractCoordinatorTest > testWakeupAfterSyncGroupReceivedExternalCompletion() FAILED
Gradle Test Run :metadata:unitTest > Gradle Test Executor 697 > QuorumControllerTest > testBootstrapZkMigrationRecord() FAILED
Gradle Test Run :metadata:unitTest > Gradle Test Executor 697 > QuorumControllerTest > testBalancePartitionLeaders() FAILED
Gradle Test Run :metadata:unitTest > Gradle Test Executor 697 > QuorumControllerTest > testBrokerHeartbeatDuringMigration(MetadataVersion) > "testBrokerHeartbeatDuringMigration(MetadataVersion).metadataVersion=3.6-IV1" FAILED
Gradle Test Run :clients:unitTest > Gradle Test Executor 703 > CooperativeConsumerCoordinatorTest > testOutdatedCoordinatorAssignment() FAILED
> Task :metadata:unitTest FAILED
> Task :clients:unitTest FAILED
$ grep ' FAILED' /tmp/unitTest2.txt
Gradle Test Run :clients:unitTest > Gradle Test Executor 1193 > AbstractCoordinatorTest > testWakeupAfterSyncGroupReceivedExternalCompletion() FAILED
Gradle Test Run :metadata:unitTest > Gradle Test Executor 1160 > QuorumControllerTest > testNoOpRecordWriteAfterTimeout() FAILED
> Task :metadata:unitTest FAILED
> Task :clients:unitTest FAILED
$ grep ' FAILED' /tmp/unitTest3.txt
Gradle Test Run :metadata:unitTest > Gradle Test Executor 1511 > QuorumControllerTest > testInsertBootstrapRecordsToEmptyLog() FAILED
> Task :metadata:unitTest FAILED
Gradle Test Run :clients:unitTest > Gradle Test Executor 1582 > Tls13SelectorTest > testCloseOldestConnection() FAILED
Gradle Test Run :clients:unitTest > Gradle Test Executor 1611 > KafkaConsumerTest > testMissingOffsetNoResetPolicy(GroupProtocol) > "testMissingOffsetNoResetPolicy(GroupProtocol).groupProtocol=CONSUMER" FAILED
> Task :clients:unitTest FAILED
> MirrorCheckpointConnector should use batched listConsumerGroupOffsets
> ---------------------------------------------------------------------
>
> Key: KAFKA-17233
> URL: https://issues.apache.org/jira/browse/KAFKA-17233
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 3.5.0
> Reporter: Greg Harris
> Assignee: João Pedro Fonseca
> Priority: Minor
> Labels: newbie
> Attachments: image-2024-08-31-15-47-14-066.png
>
>
> The AdminClient provides us a single-group listConsumerGroupOffsets, and a batched listConsumerGroupOffsets. Because we are potentially requesting the offsets for hundreds or thousands of groups, serially requesting all of the offsets may be very slow.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)