You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by I PVP <ip...@hotmail.com> on 2016/03/14 02:37:03 UTC

Consuming previous messages and from different group.id

Hi everyone,

Are there any specific configurations/properties that need to be set at the consumer or at the broker to allow:

1) The same message  M1 to be delivered to two consumers that "belong"to different consumer group.idS ?

2) A consumer to receive messages that were sent to broker before the consumer was started?

Kafka version : 0.9.0.1
Following the example available at :
http://kafka.apache.org/090/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html

Any help will be appreciated.

Thanks

--
IPVP

Re: Consuming previous messages and from different group.id

Posted by I PVP <ip...@hotmail.com>.
Hi Gerard,

Thanks for your answer.
Just to make sure I understood it correctly.
If two consumers are running , one with   group.id :  “purchase_order_metrics”  and another group.id : “purchase_order_communication” both  both consumers  doing consumer.subscribe("purchase_order_updated”) both will always receive all the messages that will come after the moment in which each consumer is up and running , without any specific configuration needed  ?

Thanks

--
IPVP


From: Gerard Klijs <ge...@dizzit.com>
Reply: users@kafka.apache.org <us...@kafka.apache.org>
Date: March 14, 2016 at 10:22:31 AM
To: users@kafka.apache.org <us...@kafka.apache.org>
Subject:  Re: Consuming previous messages and from different group.id

Hi, if you use a new group for a consumer, the auto.offset.reset value will
determine whether it will start at the beginning (with value earliest) or
at the end (with value latest). For each group a separate offset is used,
to two consumer, belonging to two different groups, when started before the
producer, will both consume each message produced.

On Mon, Mar 14, 2016 at 2:37 AM I PVP <ip...@hotmail.com> wrote:

> Hi everyone,
>
> Are there any specific configurations/properties that need to be set at
> the consumer or at the broker to allow:
>
> 1) The same message M1 to be delivered to two consumers that "belong"to
> different consumer group.idS ?
>
> 2) A consumer to receive messages that were sent to broker before the
> consumer was started?
>
> Kafka version : 0.9.0.1
> Following the example available at :
>
> http://kafka.apache.org/090/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html
>
> Any help will be appreciated.
>
> Thanks
>
> --
> IPVP
>
>

Re: Consuming previous messages and from different group.id

Posted by Gerard Klijs <ge...@dizzit.com>.
Hi, if you use a new group for a consumer, the auto.offset.reset value will
determine whether it will start at the beginning (with value earliest) or
at the end (with value latest). For each group a separate offset is used,
to two consumer, belonging to two different groups, when started before the
producer, will both consume each message produced.

On Mon, Mar 14, 2016 at 2:37 AM I PVP <ip...@hotmail.com> wrote:

> Hi everyone,
>
> Are there any specific configurations/properties that need to be set at
> the consumer or at the broker to allow:
>
> 1) The same message  M1 to be delivered to two consumers that "belong"to
> different consumer group.idS ?
>
> 2) A consumer to receive messages that were sent to broker before the
> consumer was started?
>
> Kafka version : 0.9.0.1
> Following the example available at :
>
> http://kafka.apache.org/090/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html
>
> Any help will be appreciated.
>
> Thanks
>
> --
> IPVP
>
>