You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org> on 2017/11/07 23:56:00 UTC

[jira] [Created] (SAMZA-1483) Restart or fail Samza jobs in Zk-based standalone processors when input topic partition changes

Yi Pan (Data Infrastructure) created SAMZA-1483:
---------------------------------------------------

             Summary: Restart or fail Samza jobs in Zk-based standalone processors when input topic partition changes
                 Key: SAMZA-1483
                 URL: https://issues.apache.org/jira/browse/SAMZA-1483
             Project: Samza
          Issue Type: Bug
            Reporter: Yi Pan (Data Infrastructure)


This is related to SAMZA-1482. We need to handle input stream partition count change in embedded Samza processors as well. 

In Zk-based embedded Samza processors, when a input stream partition count change is detected, we have the opportunity to trigger a JobModel update event, which would:
# for stateless jobs, restart the embedded SamzaContainer w/ new input topic partitions and new JobModel
# for stateful jobs, shutdown the embedded StreamProcessor by throwing exceptions when the input topic partitions are different



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)