You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2018/01/04 20:27:00 UTC
[jira] [Updated] (SAMZA-1483) Restart or fail Samza jobs in
Zk-based standalone processors when input topic partition changes
[ https://issues.apache.org/jira/browse/SAMZA-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xinyu Liu updated SAMZA-1483:
-----------------------------
Fix Version/s: 0.15.0
> Restart or fail Samza jobs in Zk-based standalone processors when input topic partition changes
> -----------------------------------------------------------------------------------------------
>
> Key: SAMZA-1483
> URL: https://issues.apache.org/jira/browse/SAMZA-1483
> Project: Samza
> Issue Type: Bug
> Reporter: Yi Pan (Data Infrastructure)
> Fix For: 0.15.0
>
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> This is related to SAMZA-1482. We need to handle input stream partition count change in embedded Samza processors as well.
> In Zk-based embedded Samza processors, when a input stream partition count change is detected, we have the opportunity to trigger a JobModel update event, which would:
> # for stateless jobs, restart the embedded SamzaContainer w/ new input topic partitions and new JobModel
> # for stateful jobs, shutdown the embedded StreamProcessor by throwing exceptions when the input topic partitions are different
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)