You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Daniel Nishimura (JIRA)" <ji...@apache.org> on 2018/12/19 17:59:00 UTC
[jira] [Updated] (SAMZA-2046) Startpoints - Fanout of SSP-only
keyed Startpoints to SSP+TaskName
[ https://issues.apache.org/jira/browse/SAMZA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Nishimura updated SAMZA-2046:
------------------------------------
Summary: Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName (was: Startpoints - job coordinators need to re-map startpoints from SSP key to SSP+TaskName key)
> Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName
> ------------------------------------------------------------------
>
> Key: SAMZA-2046
> URL: https://issues.apache.org/jira/browse/SAMZA-2046
> Project: Samza
> Issue Type: New Feature
> Affects Versions: 1.1
> Reporter: Daniel Nishimura
> Assignee: Daniel Nishimura
> Priority: Major
>
> The job coordinators need to call the StartpointManager#groupStartpointsPerTask method that handles the re-mapping. What needs to be implemented is when this method should be called in the job coordinators.
> YARN - ClusterBasedJobCoordinator should call the method before starting the processing containers.
> Standalone - The job coordinator should call the method when the leader is elected and before the other processors begin processing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)