You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Divij Vaidya (Jira)" <ji...@apache.org> on 2023/11/14 12:25:00 UTC
[jira] [Commented] (KAFKA-15376) Explore options of removing data earlier to the current leader's leader epoch lineage for topics enabled with tiered storage.
[ https://issues.apache.org/jira/browse/KAFKA-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17785869#comment-17785869 ]
Divij Vaidya commented on KAFKA-15376:
--------------------------------------
Hey [~ckamal]
I think the motivation of this ticket to determine whether there are alternative options to remove leader epoch. As an example, in current implementation, if the non-current leader epoch chain becomes current, we will end up losing data in remote. With this ticket we wanted to explore if we can choose to retain all non-current leader epoch chain (for case when one of them may become a current chain) and leave the garbage collection to RSM. You can find the context of the conversation at [https://github.com/apache/kafka/pull/13561#discussion_r1298029817]
I am re-opening this ticket. Please add your thoughts here if you still think that this should be resolved.
> Explore options of removing data earlier to the current leader's leader epoch lineage for topics enabled with tiered storage.
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-15376
> URL: https://issues.apache.org/jira/browse/KAFKA-15376
> Project: Kafka
> Issue Type: Task
> Components: core
> Reporter: Satish Duggana
> Assignee: Satish Duggana
> Priority: Major
> Fix For: 3.7.0
>
>
> Followup on the discussion thread:
> [https://github.com/apache/kafka/pull/13561#discussion_r1288778006]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)