[jira] [Resolved] (KAFKA-4215) Consumers miss messages during partition reassignment

["Apurva Mehta (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apurva Mehta resolved KAFKA-4215.
---------------------------------
    Resolution: Won't Fix

This is the expected behavior. When the replication factor is 1, and when we have unclean leader election, and when we lose brokers, we expect some data loss. 

> Consumers miss messages during partition reassignment
> -----------------------------------------------------
>
>                 Key: KAFKA-4215
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4215
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Apurva Mehta
>            Assignee: Apurva Mehta
>
> In the specific case where the replication-factor of a topic is 1, when partition reassignment is ongoing, and when a broker is bounced, consumers reliably lose some messages in the stream. 
> This can be reproduced in system tests where the following error message sis observed:
> {noformat}
> AssertionError: 737 acked message did not make it to the Consumer. They are: 22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550, 45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717 more. Total Acked: 51809, Total Consumed: 51073. We validated that the first 737 of these missing messages correctly made it into Kafka's data files. This suggests they were lost on their way to the consumer.
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)