[jira] [Created] (KAFKA-4215) Consumers miss messages during partition reassignment

["Apurva Mehta (JIRA)" <ji...@apache.org>]

Apurva Mehta created KAFKA-4215:
-----------------------------------

             Summary: Consumers miss messages during partition reassignment
                 Key: KAFKA-4215
                 URL: https://issues.apache.org/jira/browse/KAFKA-4215
             Project: Kafka
          Issue Type: Bug
            Reporter: Apurva Mehta
            Assignee: Apurva Mehta


In the specific case where the replication-factor of a topic is 1, when partition reassignment is ongoing, and when a broker is bounced, consumers reliably lose some messages in the stream. 

This can be reproduced in system tests where the following error message sis observed:

{noformat}
AssertionError: 737 acked message did not make it to the Consumer. They are: 22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550, 45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717 more. Total Acked: 51809, Total Consumed: 51073. We validated that the first 737 of these missing messages correctly made it into Kafka's data files. This suggests they were lost on their way to the consumer.
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)