[GitHub] [kafka] philipnee opened a new pull request, #12619: KAFKA-14196: Mark Partition unfetchable

[GitBox <gi...@apache.org>]

philipnee opened a new pull request, #12619:
URL: https://github.com/apache/kafka/pull/12619

   In KAFKA-14196 we discovered that rebalance can possibly causes some of the fetched offset being lost when autocommit was enabled, and thus causing duplication.  The reason being the fetcher continues to make progress while the async commit is trying to complete.
   
   Our solution is to mark consumer partitions unconsumable, to stop the fetcher.
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [kafka] philipnee closed pull request #12619: (WIP) KAFKA-14196: Mark partition unfetchable

[GitBox <gi...@apache.org>]

philipnee closed pull request #12619: (WIP) KAFKA-14196: Mark partition unfetchable
URL: https://github.com/apache/kafka/pull/12619


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org