You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "lh0156 (via GitHub)" <gi...@apache.org> on 2026/08/03 02:22:58 UTC

[PR] KAFKA-19107: Prune stale MirrorMaker checkpoints [kafka]

lh0156 opened a new pull request, #23054:
URL: https://github.com/apache/kafka/pull/23054

   ## Motivation
   MirrorCheckpointTask retries the same checkpoint forever when a target topic-partition has been deleted. The aggregate alter-offsets future turns a single missing partition into a recurring error, and the compacted checkpoints topic retains the stale record.
   
   ## Changes
   - Process `alterConsumerGroupOffsets` results per partition.
   - Stop retrying a partition after `UnknownTopicOrPartitionException`.
   - Emit a checkpoint tombstone so the stale record is removed from the compacted topic.
   - Apply checkpoint tombstones when loading `CheckpointStore`.
   - Synchronize checkpoint-store access used by poll and offset-sync scheduler.
   
   ## Tests
   - `./gradlew :connect:mirror-client:test :connect:mirror:test`
   - `./gradlew :connect:mirror-client:spotlessCheck :connect:mirror:spotlessCheck :connect:mirror-client:checkstyleMain :connect:mirror-client:checkstyleTest :connect:mirror:checkstyleMain :connect:mirror:checkstyleTest :connect:mirror-client:spotbugsMain :connect:mirror:spotbugsMain`
   - `git diff --check`
   
   Jira: https://issues.apache.org/jira/browse/KAFKA-19107


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-19107: Prune stale MirrorMaker checkpoints [kafka]

Posted by "lh0156 (via GitHub)" <gi...@apache.org>.
lh0156 commented on PR #23054:
URL: https://github.com/apache/kafka/pull/23054#issuecomment-5301415233

   Closing this PR to reduce the number of parallel contributions and avoid consuming maintainer bandwidth before scope and ownership have been confirmed. I'll revisit KAFKA-19107 only after aligning with maintainers on the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-19107: Prune stale MirrorMaker checkpoints [kafka]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #23054:
URL: https://github.com/apache/kafka/pull/23054#issuecomment-5235599984

   A label of 'needs-attention' was automatically added to this PR in order to raise the
   attention of the committers. Once this issue has been triaged, the `triage` label
   should be removed to prevent this automation from happening again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-19107: Prune stale MirrorMaker checkpoints [kafka]

Posted by "mingyen066 (via GitHub)" <gi...@apache.org>.
mingyen066 commented on PR #23054:
URL: https://github.com/apache/kafka/pull/23054#issuecomment-5161720459

   Please stop sending Please stop your AI agent loop from continuously spamming PRs like this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] KAFKA-19107: Prune stale MirrorMaker checkpoints [kafka]

Posted by "lh0156 (via GitHub)" <gi...@apache.org>.
lh0156 closed pull request #23054: KAFKA-19107: Prune stale MirrorMaker checkpoints
URL: https://github.com/apache/kafka/pull/23054


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: jira-unsubscribe@kafka.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org