You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jay Kreps (JIRA)" <ji...@apache.org> on 2012/10/09 20:14:03 UTC
[jira] [Updated] (KAFKA-560) Garbage Collect obsolete topics

     [ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jay Kreps updated KAFKA-560:
----------------------------

    Description: 
Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have a tool that could delete any topic that had not been written to in a configurable period of time and had no active consumer groups. Something like
   ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?

  was:
Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have tool that could delete any topic that had not been written to in a configurable period of time. Something like
   ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?

    
> Garbage Collect obsolete topics
> -------------------------------
>
>                 Key: KAFKA-560
>                 URL: https://issues.apache.org/jira/browse/KAFKA-560
>             Project: Kafka
>          Issue Type: New Feature
>            Reporter: Jay Kreps
>
> Old junk topics tend to accumulate over time. Code may migrate to use new topics leaving the old ones orphaned. Likewise there are some use cases for temporary transient topics. It would be good to have a tool that could delete any topic that had not been written to in a configurable period of time and had no active consumer groups. Something like
>    ./bin/delete-unused-topics.sh --last-write [date] --zookeeper [zk_connect]
> This requires API support to get the last update time. I think it may be possible to do this through the OffsetRequest now?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira