You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Shanthoosh Venkataraman (JIRA)" <ji...@apache.org> on 2018/02/13 00:55:00 UTC
[jira] [Updated] (SAMZA-1585) Followers stopping themselves when
their processorID doesn't exist in JobModel.
[ https://issues.apache.org/jira/browse/SAMZA-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shanthoosh Venkataraman updated SAMZA-1585:
-------------------------------------------
Description:
When a follower reads the propagated JobModel and finds out that it's processorID does not exist in the JobModel, the follower process will kill itself.
If the follower joins the group when the leader is in the middle of generating the JobModel, the newly generated JobModel will not have the follower;s processorID(since the leader has not seen the change(follower joining the group)) and the follower will kill itself.
This will trigger unexpected rebalance phases in the processors group and will overload some stream processors in the group.
was:
When a follower reads the propagated JobModel and finds out that it's processorID does not exist in the JobModel, the follower process will kill itself.
If the follower joins the group when the leader is in the middle of generating the JobModel, the newly generated JobModel will not have the follower;s processorID(since the leader has not seen the change(follower joining the group)) and the follower will kill itself.
This is not an expected behavior and will trigger unexpected rebalance phases in the processors group.
> Followers stopping themselves when their processorID doesn't exist in JobModel.
> -------------------------------------------------------------------------------
>
> Key: SAMZA-1585
> URL: https://issues.apache.org/jira/browse/SAMZA-1585
> Project: Samza
> Issue Type: Bug
> Reporter: Shanthoosh Venkataraman
> Assignee: Shanthoosh Venkataraman
> Priority: Major
>
> When a follower reads the propagated JobModel and finds out that it's processorID does not exist in the JobModel, the follower process will kill itself.
> If the follower joins the group when the leader is in the middle of generating the JobModel, the newly generated JobModel will not have the follower;s processorID(since the leader has not seen the change(follower joining the group)) and the follower will kill itself.
> This will trigger unexpected rebalance phases in the processors group and will overload some stream processors in the group.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)