You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by GitBox <gi...@apache.org> on 2020/05/29 20:05:40 UTC
[GitHub] [kafka] hachikuji opened a new pull request #8758: KAFKA-8104: Consumer cannot rejoin to the group after rebalancing
hachikuji opened a new pull request #8758:
URL: https://github.com/apache/kafka/pull/8758
This PR is a backport of #7460 for 2.2. It also contains part of #7451.
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hachikuji merged pull request #8758: KAFKA-8104: Consumer cannot rejoin to the group after rebalancing
Posted by GitBox <gi...@apache.org>.
hachikuji merged pull request #8758:
URL: https://github.com/apache/kafka/pull/8758
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] guozhangwang commented on pull request #8758: KAFKA-8104: Consumer cannot rejoin to the group after rebalancing
Posted by GitBox <gi...@apache.org>.
guozhangwang commented on pull request #8758:
URL: https://github.com/apache/kafka/pull/8758#issuecomment-636171805
LGTM
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hachikuji commented on a change in pull request #8758: KAFKA-8104: Consumer cannot rejoin to the group after rebalancing
Posted by GitBox <gi...@apache.org>.
hachikuji commented on a change in pull request #8758:
URL: https://github.com/apache/kafka/pull/8758#discussion_r432710229
##########
File path: clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinatorTest.java
##########
@@ -1956,6 +1957,60 @@ public void testAutoCommitAfterCoordinatorBackToService() {
assertEquals(100L, subscriptions.position(t1p).longValue());
}
+ @Test
+ public void testConsumerRejoinAfterRebalance() throws Exception {
+ try (ConsumerCoordinator coordinator = prepareCoordinatorForCloseTest(true, false, false)) {
+ coordinator.ensureActiveGroup();
+
+ prepareOffsetCommitRequest(singletonMap(t1p, 100L), Errors.REBALANCE_IN_PROGRESS);
+
+ try {
+ coordinator.commitOffsetsSync(singletonMap(t1p, new OffsetAndMetadata(100L)),
+ time.timer(Long.MAX_VALUE));
+ fail("Expected commit failure");
+ } catch (CommitFailedException e) {
+ // Expected
+ }
+
+ assertFalse(client.hasPendingResponses());
+ assertFalse(client.hasInFlightRequests());
+
+ int generationId = 42;
+ String memberId = "consumer-42";
+
+ client.prepareResponse(joinGroupFollowerResponse(generationId, memberId, "leader", Errors.NONE));
+
+ MockTime time = new MockTime(1);
+
+ //onJoinPrepare will be executed and onJoinComplete will not.
+ boolean res = coordinator.joinGroupIfNeeded(time.timer(2));
+
+ assertFalse(res);
+ assertFalse(client.hasPendingResponses());
+ //SynGroupRequest not responded.
+ assertEquals(1, client.inFlightRequestCount());
+ assertEquals(generationId, coordinator.generation().generationId);
+ assertEquals(memberId, coordinator.generation().memberId);
+
+ // Imitating heartbeat thread that clears generation data.
+ coordinator.maybeLeaveGroup();
+
+ assertEquals(AbstractCoordinator.Generation.NO_GENERATION, coordinator.generation());
+
+ client.respond(syncGroupResponse(singletonList(t1p), Errors.NONE));
+
+ //Join future should succeed but generation already cleared so result of join is false.
+ res = coordinator.joinGroupIfNeeded(time.timer(1));
+
+ assertFalse(res);
+ assertFalse(client.hasPendingResponses());
+
+ // We just have the LeaveGroup
+ assertEquals(1, client.inFlightRequestCount());
Review comment:
Note this assertion is a bit different form 2.3 onwards because we do not have the groupInstanceId which prevents the sending of LeaveGroup in the call to `maybeLeaveGroup` above.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org