Kafka Consumers getting overlapped data

[Rahul R <ra...@gmail.com>]

I have 2 kafka consumers. Both the consumers have the same group_id. One is
written in java [1] and the other in python. According to the documentation
[2] ,  if both the consumers have the same group_id , then I should be
getting non-overlapping set of data . But in this case, both the consumers
are getting all the data. I have not digressed from the default setting.
Any idea on whats going on ?

Thanks,
./R

[1] https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
[2] http://kafka.apache.org/documentation.html

Re: Kafka Consumers getting overlapped data

[Todd Palino <tp...@gmail.com>]

What Python library are you using?

In addition, there's no real guarantee that any two libraries will
implement consumer balancing using the same algorithm (if they do it at
all).

-Todd


On Wednesday, September 30, 2015, Rahul R <ra...@gmail.com> wrote:

> I have 2 kafka consumers. Both the consumers have the same group_id. One is
> written in java [1] and the other in python. According to the documentation
> [2] ,  if both the consumers have the same group_id , then I should be
> getting non-overlapping set of data . But in this case, both the consumers
> are getting all the data. I have not digressed from the default setting.
> Any idea on whats going on ?
>
> Thanks,
> ./R
>
> [1]
> https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
> [2] http://kafka.apache.org/documentation.html
>