More partitions than consumers

[Vetle Leinonen-Roeim <ve...@roeim.net>]

Hi,

As far as I can see, the (otherwise great and very helpful) 
documentation isn't explicit about this, but: given more partitions than 
consumers, will all messages still be read?

I've discussed this with some people, and there is some disagreement, so 
a clear answer to this would be greatly appriciated!

Regards,
Vetle

Re: More partitions than consumers

[Vetle Leinonen-Roeim <ve...@roeim.net>]

Exactly what I'm looking for. Thanks! :)

On 26.08.14 19:08, Gwen Shapira wrote:
> I hope this helps:
>
> https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
>
> "if you have more partitions than you have threads, some threads will
> receive data from multiple partitions"
>
> On Tue, Aug 26, 2014 at 10:00 AM, Vetle Leinonen-Roeim <ve...@roeim.net> wrote:
>> Hi,
>>
>> As far as I can see, the (otherwise great and very helpful) documentation
>> isn't explicit about this, but: given more partitions than consumers, will
>> all messages still be read?
>>
>> I've discussed this with some people, and there is some disagreement, so a
>> clear answer to this would be greatly appriciated!
>>
>> Regards,
>> Vetle
>

Re: More partitions than consumers

[Gwen Shapira <gs...@cloudera.com>]

I hope this helps:

https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example

"if you have more partitions than you have threads, some threads will
receive data from multiple partitions"

On Tue, Aug 26, 2014 at 10:00 AM, Vetle Leinonen-Roeim <ve...@roeim.net> wrote:
> Hi,
>
> As far as I can see, the (otherwise great and very helpful) documentation
> isn't explicit about this, but: given more partitions than consumers, will
> all messages still be read?
>
> I've discussed this with some people, and there is some disagreement, so a
> clear answer to this would be greatly appriciated!
>
> Regards,
> Vetle