You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jay Kreps (JIRA)" <ji...@apache.org> on 2012/10/09 20:10:03 UTC
[jira] [Created] (KAFKA-559) Garbage collect old consumer metadata
entries
Jay Kreps created KAFKA-559:
-------------------------------
Summary: Garbage collect old consumer metadata entries
Key: KAFKA-559
URL: https://issues.apache.org/jira/browse/KAFKA-559
Project: Kafka
Issue Type: New Feature
Reporter: Jay Kreps
Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like
bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect]
This would scan through consumer group entries and delete any that had no offset update since the given date.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-559) Garbage collect old consumer
metadata entries
Posted by "Neha Narkhede (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13472807#comment-13472807 ]
Neha Narkhede commented on KAFKA-559:
-------------------------------------
This is a good tool to have. In addition to being able to remove the consumer groups with no offset updates since the zk modified timestamp, it will be good to add a defensive check to ensure that there are no consumers currently registered under that group. This will prevent us from accidentally deleting the offset information for alive consumer groups.
> Garbage collect old consumer metadata entries
> ---------------------------------------------
>
> Key: KAFKA-559
> URL: https://issues.apache.org/jira/browse/KAFKA-559
> Project: Kafka
> Issue Type: New Feature
> Reporter: Jay Kreps
>
> Many use cases involve tranient consumers. These consumers create entries under their consumer group in zk and maintain offsets there as well. There is currently no way to delete these entries. It would be good to have a tool that did something like
> bin/delete-obsolete-consumer-groups.sh [--topic t1] --since [date] --zookeeper [zk_connect]
> This would scan through consumer group entries and delete any that had no offset update since the given date.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira