You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org> on 2022/04/15 23:53:00 UTC
[jira] [Created] (SAMZA-2733) [Elasticity] Compute last processed offsets when container starts up using checkpoints from previous deploys when elasticity was enabled
Lakshmi Manasa Gaduputi created SAMZA-2733:
----------------------------------------------
Summary: [Elasticity] Compute last processed offsets when container starts up using checkpoints from previous deploys when elasticity was enabled
Key: SAMZA-2733
URL: https://issues.apache.org/jira/browse/SAMZA-2733
Project: Samza
Issue Type: Sub-task
Reporter: Lakshmi Manasa Gaduputi
Assignee: Lakshmi Manasa Gaduputi
Checkpoint key contains task name and that task name is used for last processed offsets when container starts up. However, with elasticity task names change as follows from "Partition 0" to "Partition 0_1_2" (0 is the input partition, 1 is the key bucket and 2 is the elasticity factor). Thus when elasticity is enabled then computing last processed offsets need to take into account both Partition 0 and Partition 0_1_2 when computing checkpoint for either.
This ticket is to update the OffsetManager to do this computation for elasticity
--
This message was sent by Atlassian Jira
(v8.20.1#820001)