You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Neha Narkhede (JIRA)" <ji...@apache.org> on 2013/04/02 17:57:15 UTC

[jira] [Updated] (KAFKA-842) Mirror maker can lose some messages during shutdown

     [ https://issues.apache.org/jira/browse/KAFKA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neha Narkhede updated KAFKA-842:
--------------------------------

    Attachment: kafka-842.patch

Mirror maker was losing few messages even on a clean shutdown. This is because, on shutdown, we only waited for the embedded producer to send data to an async producer. The messages were lost from the async producer's queue since we didn't call producer.close() that flushes the outstanding messages in the producer's queue. 

This patch fixes the bug. The system test failed due to this bug and another bug in the system test itself. Will file a separate bug to fix the test.
                
> Mirror maker can lose some messages during shutdown
> ---------------------------------------------------
>
>                 Key: KAFKA-842
>                 URL: https://issues.apache.org/jira/browse/KAFKA-842
>             Project: Kafka
>          Issue Type: Bug
>          Components: tools
>    Affects Versions: 0.8
>            Reporter: Neha Narkhede
>            Assignee: Neha Narkhede
>            Priority: Critical
>         Attachments: kafka-842.patch
>
>
> On shutdown, mirror maker can lose a few messages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira