You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Dominic Kim <st...@gmail.com> on 2018/10/23 07:16:29 UTC

The limit on the number of consumers in a group.

Dear all.

Is there any limit on the number of consumers in a group?
I want to utilize about 300 or more consumers in a group, but rebalancing
hangs and never get finished.
When I invoke only 130~140 consumers in a group, it works fine.
Buf from 150 consumers, rebalancing is never stopped.

Is this an expected behavior? or Did I miss or misconfigure something?

Thanks
Regards
Dominic.

Re: The limit on the number of consumers in a group.

Posted by "Matthias J. Sax" <ma...@confluent.io>.
Rebalancing is expected to take longer for larger groups. But it should
work nevertheless.

I would recommend to dig into the logs: does a single rebalance "hang"
or do you get multiple rebalances triggered after each other?


-Matthias

On 10/23/18 12:16 AM, Dominic Kim wrote:
> Dear all.
> 
> Is there any limit on the number of consumers in a group?
> I want to utilize about 300 or more consumers in a group, but rebalancing
> hangs and never get finished.
> When I invoke only 130~140 consumers in a group, it works fine.
> Buf from 150 consumers, rebalancing is never stopped.
> 
> Is this an expected behavior? or Did I miss or misconfigure something?
> 
> Thanks
> Regards
> Dominic.
>