[jira] [Created] (KAFKA-1612) Consumer offsets auto-commit before processing finishes

["Gian Merlino (JIRA)" <ji...@apache.org>]

Gian Merlino created KAFKA-1612:
-----------------------------------

             Summary: Consumer offsets auto-commit before processing finishes
                 Key: KAFKA-1612
                 URL: https://issues.apache.org/jira/browse/KAFKA-1612
             Project: Kafka
          Issue Type: Bug
          Components: consumer
    Affects Versions: 0.8.1.1
            Reporter: Gian Merlino
            Assignee: Neha Narkhede


In a loop like this,

  for (message <- kafkaStream) {
     process(message)
  }

The consumer can commit offsets for the next message while "process" is running. If the program crashes during "process", the next run will pick up from the *next* message. The message in flight at the time of the crash will never actually finish processing. Instead, I would have expected the high level consumer to deliver messages at least once.



--
This message was sent by Atlassian JIRA
(v6.2#6252)