You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Jason Gustafson (JIRA)" <ji...@apache.org> on 2015/12/03 06:59:10 UTC

[jira] [Created] (KAFKA-2942) Inadvertent auto-commit when pre-fetching can cause message loss

Jason Gustafson created KAFKA-2942:
--------------------------------------

             Summary: Inadvertent auto-commit when pre-fetching can cause message loss
                 Key: KAFKA-2942
                 URL: https://issues.apache.org/jira/browse/KAFKA-2942
             Project: Kafka
          Issue Type: Bug
            Reporter: Jason Gustafson
            Assignee: Jason Gustafson


Before returning from KafkaConsumer.poll(), we update the consumed position and invoke poll(0) to send new fetches. In doing so, it is possible that an auto-commit is triggered which would commit the updated offsets which hasn't yet been returned. If the process then crashes before consuming the messages, there would be a gap in the delivery.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)