You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Vahid Hashemian (JIRA)" <ji...@apache.org> on 2016/05/23 18:39:13 UTC

[jira] [Commented] (KAFKA-3120) Consumer doesn't get messages from some partitions after reassign

    [ https://issues.apache.org/jira/browse/KAFKA-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296845#comment-15296845 ] 

Vahid Hashemian commented on KAFKA-3120:
----------------------------------------

I can't reproduce this using the current trunk.

> Consumer doesn't get messages from some partitions after reassign
> -----------------------------------------------------------------
>
>                 Key: KAFKA-3120
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3120
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.9.0.0
>         Environment: Linux
>            Reporter: Jakub Neubauer
>            Priority: Critical
>
> I tested some scenario on one-node cluster with this setup:
> * A topic with 5 partitions, 1 replica.
> * One producer (new java client)
> * 2 consumers were started (let's say A and B). Using the new java client. 2 partitions to A, 3 partitions to B were assigned.
> Then I stopped one of the consumers (cleanly). The partitions were re-assigned (The consumer got all 5 partitions in the "ConsumerRebalanceListener.onPartitionsAssigned" listener.
> But as messages were produced, the living consumer received only messages of some partitions (magically those that belonged to the now-dead consumer).
> The messages were not lost. After I restarted the second consumer, it got the messages that it previously didn't get. But without restarting, the messages were not consumed by it.
> It is quite serious issue, since there is no sign of something being wrong. Everything seems to be working. So the administrator has no chance to get the idea that (only some) messages are not consumed on the "healthy" system.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)