You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by GitBox <gi...@apache.org> on 2019/10/04 21:15:27 UTC

[GitHub] [samza] dnishimura opened a new pull request #1179: SAMZA-2334: SSPGrouperProxy should check if job is stateful, not if host-affinity is enabled

dnishimura opened a new pull request #1179: SAMZA-2334: SSPGrouperProxy should check if job is stateful, not if host-affinity is enabled
URL: https://github.com/apache/samza/pull/1179
 
 
   The current `SSPGrouperProxy` provides the capability for input partition counts to expand or contract by a multiple of the previous count. This is only need by stateful jobs. Currently the check for stateful jobs is to see if `host-affinity` is enabled. However, that is the wrong check because `host-affinity` does not imply a job is stateful. 
   
   The fix here is to check to see if the job has any local state stores rather than checking if `host-affinity` is enabled. The other part of the fix is to allow disabling the `SSPGrouperProxy` in the situation where the job cannot expand or contract the input partitions by an appropriate factor.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services