You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Bharath Kumarasubramanian (Jira)" <ji...@apache.org> on 2020/12/08 19:22:00 UTC

[jira] [Updated] (SAMZA-2609) Data model changes to track lifecycle information of job coordinator

     [ https://issues.apache.org/jira/browse/SAMZA-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bharath Kumarasubramanian updated SAMZA-2609:
---------------------------------------------
    Fix Version/s: 1.7

> Data model changes to track lifecycle information of job coordinator
> --------------------------------------------------------------------
>
>                 Key: SAMZA-2609
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2609
>             Project: Samza
>          Issue Type: New Feature
>            Reporter: Bharath Kumarasubramanian
>            Assignee: Bharath Kumarasubramanian
>            Priority: Major
>             Fix For: 1.7
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> *Goal*: Implement the data model changes needed to track the lifecycle of AM.
> *Description*: With AM HA, the new AM will regenerate job model, do job planning and rewrite configurations and may have to spin up containers. The new rewritten configurations, job model can change from the existing metadata on which the containers are running. In order to handle this change of metadata, we need a way to identify lifecycle of the AM and store some information on the previous snapshot of the metadata.
> *Changes*: 
>  # Epoch identifier of the AM attempt so that we can determine if the new attempt is part of the same lifecycle of AM or a new deployment lifecycle
>  # Additional information on the job model, configuration (potentially subset of it) so that we can use this information to decide the course of action if current metadata changed in comparison with the previous snapshot.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)