[jira] [Updated] (KAFKA-1088) Ability to create a shadow consumer group

["Jason Gustafson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-1088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Gustafson updated KAFKA-1088:
-----------------------------------
    Fix Version/s:     (was: 0.10.1.0)
                   0.10.2.0

> Ability to create a shadow consumer group
> -----------------------------------------
>
>                 Key: KAFKA-1088
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1088
>             Project: Kafka
>          Issue Type: New Feature
>          Components: consumer
>            Reporter: Andrew Olson
>            Assignee: Neha Narkhede
>             Fix For: 0.10.2.0
>
>
> I have a consumer group API request that hopefully can be included in the client rewrite [1] project: the ability to create a new consumer group that is initialized to the latest topic/partition offsets of another existing group. Our use case is being able to inspect an active group's unprocessed messages in a non-invasive manner from an admin or troubleshooting perspective. This shadow group would be short-lived and given a randomly generated  name. It's nice to see that we'll be able to designate it as ephemeral as well so that it is automatically cleaned up.
> To obtain this message browsing functionality today with 0.8, we programmatically copy the group ZK paths prior to activating the "spy" group so that it only sees the unprocessed messages of the target. Obviously not ideal, but it worked well as a quick hack since we understand how Kafka writes and reads the offset data in ZK.
> [1] https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)