You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Ajo Thomas (Jira)" <ji...@apache.org> on 2022/12/16 17:41:00 UTC

[jira] [Resolved] (SAMZA-2747) Standby bug fixes

     [ https://issues.apache.org/jira/browse/SAMZA-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajo Thomas resolved SAMZA-2747.
-------------------------------
    Resolution: Fixed

> Standby bug fixes
> -----------------
>
>                 Key: SAMZA-2747
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2747
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Bharath Kumarasubramanian
>            Assignee: Bharath Kumarasubramanian
>            Priority: Major
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> {*}Problem{*}:
>  * Standby feature is broken for jobs that don't have explicit side inputs
>  * Change logged stores are treated as non-change logged for standby containers
> {*}Description{*}:
> [PR 1367|https://github.com/apache/samza/pull/1367] - Introduced a bug where jobs with no side inputs caused jobs to not bootstrap data for logged stores. The root cause was related to mutation of _taskSideInputStoreSSPs_ as _changelogSSPs_ that were added to it during initialization were ignored since the initialization of _hasSideInputs_ happened before.
> [PR 1491|https://github.com/apache/samza/pull/1491] - Introduced a bug where the logged stores were incorrectly classified as non-logged stores for standby container resulting in discarding of state at the end of container lifecycle. The root cause was similar to above where _sideInputStoreNames_ was initialized prior to updating _changelogSSPs_ 
> Bottom line: Mutation of certain fields related to side inputs were out of order and refactor PRs (1367 and 1491) were not aware of this assumption.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)