You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Cameron Lee (JIRA)" <ji...@apache.org> on 2019/03/05 20:23:00 UTC

[jira] [Created] (SAMZA-2121) Add checkpoint offset field to IncomingMessageEnvelope

Cameron Lee created SAMZA-2121:
----------------------------------

             Summary: Add checkpoint offset field to IncomingMessageEnvelope
                 Key: SAMZA-2121
                 URL: https://issues.apache.org/jira/browse/SAMZA-2121
             Project: Samza
          Issue Type: New Feature
            Reporter: Cameron Lee
            Assignee: Cameron Lee


In some cases, the offset to checkpoint may not match the plain offset associated with an individual message.

If large messages are supported in Kafka by segmenting them into smaller individual messages, then the plain offset of a message might fall in the middle of the segments of a large message. We do not want to checkpoint in the middle of a large message.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)