You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Bharath Kumarasubramanian (Jira)" <ji...@apache.org> on 2020/12/02 12:22:00 UTC
[jira] [Created] (SAMZA-2609) Data model changes to track lifecycle
information of job coordinator
Bharath Kumarasubramanian created SAMZA-2609:
------------------------------------------------
Summary: Data model changes to track lifecycle information of job coordinator
Key: SAMZA-2609
URL: https://issues.apache.org/jira/browse/SAMZA-2609
Project: Samza
Issue Type: New Feature
Reporter: Bharath Kumarasubramanian
Assignee: Bharath Kumarasubramanian
*Goal*: Implement the data model changes needed to track the lifecycle of AM.
*Description*: With AM HA, the new AM will regenerate job model, do job planning and rewrite configurations and may have to spin up containers. The new rewritten configurations, job model can change from the existing metadata on which the containers are running. In order to handle this change of metadata, we need a way to identify lifecycle of the AM and store some information on the previous snapshot of the metadata.
*Changes*:
# Epoch identifier of the AM attempt so that we can determine if the new attempt is part of the same lifecycle of AM or a new deployment lifecycle
# Additional information on the job model, configuration (potentially subset of it) so that we can use this information to decide the course of action if current metadata changed in comparison with the previous snapshot.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)