You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "hudeqi (via GitHub)" <gi...@apache.org> on 2023/06/29 09:40:39 UTC
[GitHub] [kafka] hudeqi opened a new pull request, #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
hudeqi opened a new pull request, #13930:
URL: https://github.com/apache/kafka/pull/13930
### Motivation
Firstly, let me post the exception log of the client running:
"org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records."
This is the client exception log provided to us by the online business. First, we confirmed that there is no issue on the server brokers. Then according to the exception prompt information, it may be judged that the settings of "max.poll.interval.ms" and "max.poll.records" may be unreasonable, but the actual processing time of business printing is much shorter than "max.poll.interval.ms", so We're sure that's not the reason. In the end, it was found that there is such a case: the business uses a "group id" to subscribe to some partitions of "topic1" through the simple consumer mode, and set "auto.offset.reset=false". When using the same "group id" name to start a high level consumer on "topic2", the original service using simple consumer throws CommitFailedException. And I have reproduced this process.
### Solution
In fact, this is not a bug, but a problem with the way the client is used, but I think the exception message of `CommitFailedException` may have imperfect and misleading guidance, so I have enriched the message that there may be special situations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hudeqi commented on pull request #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
Posted by "hudeqi (via GitHub)" <gi...@apache.org>.
hudeqi commented on PR #13930:
URL: https://github.com/apache/kafka/pull/13930#issuecomment-1613522211
Hi! Could you help to review this PR? @hachikuji @guozhangwang
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hudeqi commented on pull request #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
Posted by "hudeqi (via GitHub)" <gi...@apache.org>.
hudeqi commented on PR #13930:
URL: https://github.com/apache/kafka/pull/13930#issuecomment-1702034716
Hi, if there is no sense in modifying this issue, I will close this PR and the corresponding jira. @dajac
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hudeqi commented on pull request #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
Posted by "hudeqi (via GitHub)" <gi...@apache.org>.
hudeqi commented on PR #13930:
URL: https://github.com/apache/kafka/pull/13930#issuecomment-1630338979
@dajac Hi! Could you help to review this PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kafka] hudeqi commented on pull request #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
Posted by "hudeqi (via GitHub)" <gi...@apache.org>.
hudeqi commented on PR #13930:
URL: https://github.com/apache/kafka/pull/13930#issuecomment-1737000786
@showuon Hi, Could you help to review this PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-15134:Enrich the prompt reason in CommitFailedException [kafka]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #13930:
URL: https://github.com/apache/kafka/pull/13930#issuecomment-1879522834
This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge conflicts, please update it with the latest from trunk (or appropriate release branch) <p> If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] KAFKA-15134:Enrich the prompt reason in CommitFailedException [kafka]
Posted by "hudeqi (via GitHub)" <gi...@apache.org>.
hudeqi closed pull request #13930: KAFKA-15134:Enrich the prompt reason in CommitFailedException
URL: https://github.com/apache/kafka/pull/13930
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org