You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Vahid Hashemian (JIRA)" <ji...@apache.org> on 2018/04/27 20:03:00 UTC

[jira] [Commented] (KAFKA-6774) Improve default groupId behavior in consumer

    [ https://issues.apache.org/jira/browse/KAFKA-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456974#comment-16456974 ] 

Vahid Hashemian commented on KAFKA-6774:
----------------------------------------

[~hachikuji], it seems that the stand-alone consumer (using {{assign(...)}}) cannot currently fetch successfully without seeking to an offset first. It seems {{auto.offset.reset}} does not kick-in in this case. Am I correct? If so, is it something we also want to change as part of this JIRA?

> Improve default groupId behavior in consumer
> --------------------------------------------
>
>                 Key: KAFKA-6774
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6774
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>            Reporter: Jason Gustafson
>            Assignee: Vahid Hashemian
>            Priority: Major
>              Labels: needs-kip
>
> At the moment, the default groupId in the consumer is "". If you try to use this to subscribe() to a topic, the broker will reject the group as invalid. On the other hand, if you use it with assign(), then the user will be able to fetch and commit offsets using the empty groupId. Probably 99% of the time, this is not what the user expects. Instead you would probably expect that if no groupId is provided, then no committed offsets will be fetched at all and we'll just use the auto reset behavior if we don't have a current position.
> Here are two potential solutions (both requiring a KIP):
> 1. Change the default to null. We will preserve the current behavior for subscribe(). When using assign(), we will not bother fetching committed offsets for the null groupId, and any attempt to commit offsets will raise an error. The user can still use the empty groupId, but they have to specify it explicitly.
> 2. Keep the current default, but change the consumer to treat this value as if it were null as described in option 1. The argument for this behavior is that using the empty groupId to commit offsets is inherently a dangerous practice and should not be permitted. We'd have to convince ourselves that we're fine not needing to allow the empty groupId for backwards compatibility though.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)