You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org> on 2022/04/16 03:10:00 UTC

[jira] [Created] (SAMZA-2734) [Elasticity] Update last processed offset after an envelope is finished processing when elasticity is enabled

Lakshmi Manasa Gaduputi created SAMZA-2734:
----------------------------------------------

             Summary: [Elasticity] Update last processed offset after an envelope is finished processing when elasticity is enabled
                 Key: SAMZA-2734
                 URL: https://issues.apache.org/jira/browse/SAMZA-2734
             Project: Samza
          Issue Type: Sub-task
            Reporter: Lakshmi Manasa Gaduputi
            Assignee: Lakshmi Manasa Gaduputi


OffsetManager maintains the last processed offsets for each input ssp of a task.

Upon completion of an envelope's processing, OffsetManager.update(taskName, ssp, offset) is invoked. 

With elasticity enabled, the ssp maintained by the Offsetmanager has keyBucket information whereas update can be invoked with ssp without keyBucket info. This needs to be appropriately adjusted.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)