You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Goltseva Taisiia (Jira)" <ji...@apache.org> on 2020/06/01 11:32:00 UTC

[jira] [Commented] (KAFKA-560) Garbage Collect obsolete topics

    [ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120958#comment-17120958 ] 

Goltseva Taisiia commented on KAFKA-560:
----------------------------------------

I'm looking for an option on Kafka for auto deletion of old unused topics. There is no such option, right?

I wonder why? I think it's no less important than deleting old messages via retention policy. Because there are collecting lot's of unused topics consuming recources in dev environments. It would be very useful from my point of view to delete such old topics automatically.

> Garbage Collect obsolete topics
> -------------------------------
>
>                 Key: KAFKA-560
>                 URL: https://issues.apache.org/jira/browse/KAFKA-560
>             Project: Kafka
>          Issue Type: New Feature
>            Reporter: Jay Kreps
>            Assignee: Harsha
>            Priority: Major
>              Labels: project
>
> Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have a tool that could delete any topic that had not been written to in a configurable period of time and had no active consumer groups. Something like
>    ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
> This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)