You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org> on 2022/04/15 23:53:00 UTC

[jira] [Created] (SAMZA-2733) [Elasticity] Compute last processed offsets when container starts up using checkpoints from previous deploys when elasticity was enabled

Lakshmi Manasa Gaduputi created SAMZA-2733:
----------------------------------------------

             Summary: [Elasticity] Compute last processed offsets when container starts up using checkpoints from previous deploys when elasticity was enabled
                 Key: SAMZA-2733
                 URL: https://issues.apache.org/jira/browse/SAMZA-2733
             Project: Samza
          Issue Type: Sub-task
            Reporter: Lakshmi Manasa Gaduputi
            Assignee: Lakshmi Manasa Gaduputi


Checkpoint key contains task name and that task name is used for last processed offsets when container starts up. However, with elasticity task names change as follows from "Partition 0" to "Partition 0_1_2" (0 is the input partition, 1 is the key bucket and 2 is the elasticity factor). Thus when elasticity is enabled then computing last processed offsets need to take into account both Partition 0 and Partition 0_1_2 when computing checkpoint for either. 

This ticket is to update the OffsetManager to  do this computation for elasticity



--
This message was sent by Atlassian Jira
(v8.20.1#820001)