You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jürgen Ziegler <ju...@outlook.com> on 2015/09/15 13:46:37 UTC

kafka consumer thread killed - no more message consumption

Hi all,

I'm playing around with the kafka high level java api.

If I have multiple consumers in a group, consuming the same topic with a
single partition, only one consumer will receive messages, as is expected.
When shutting down the consumer, another consumer will automatically
consume the messages.
If the picked consumer thread dies (killed, not shutdown!), is it the
expected behavior that no other consumer will consume the leftover messages?
That's at least what I'm experiencing, which seems weird to me.

Thanks!

Re: kafka consumer thread killed - no more message consumption

Posted by Li Tao <ah...@gmail.com>.
Hi, I think there is no difference between shutting down a consumer or
killing a consumer.
For the whole system, it only means a consumer has left for some reason
which is not interested.

So if you kill a consumer, some consumer in the same consumer group should
take over and consume messages.
Correct me if I am wrong.

On Tue, Sep 15, 2015 at 7:46 PM, Jürgen Ziegler <juergen.ziegler@outlook.com
> wrote:

> Hi all,
>
> I'm playing around with the kafka high level java api.
>
> If I have multiple consumers in a group, consuming the same topic with a
> single partition, only one consumer will receive messages, as is expected.
> When shutting down the consumer, another consumer will automatically
> consume the messages.
> If the picked consumer thread dies (killed, not shutdown!), is it the
> expected behavior that no other consumer will consume the leftover
> messages?
> That's at least what I'm experiencing, which seems weird to me.
>
> Thanks!
>