You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Daniel Nishimura (JIRA)" <ji...@apache.org> on 2018/12/19 17:59:00 UTC

[jira] [Updated] (SAMZA-2046) Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName

     [ https://issues.apache.org/jira/browse/SAMZA-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Nishimura updated SAMZA-2046:
------------------------------------
    Summary: Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName  (was: Startpoints - job coordinators need to re-map startpoints from SSP key to SSP+TaskName key)

> Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName
> ------------------------------------------------------------------
>
>                 Key: SAMZA-2046
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2046
>             Project: Samza
>          Issue Type: New Feature
>    Affects Versions: 1.1
>            Reporter: Daniel Nishimura
>            Assignee: Daniel Nishimura
>            Priority: Major
>
> The job coordinators need to call the StartpointManager#groupStartpointsPerTask method that handles the re-mapping. What needs to be implemented is when this method should be called in the job coordinators.
> YARN - ClusterBasedJobCoordinator should call the method before starting the processing containers.
> Standalone - The job coordinator should call the method when the leader is elected and before the other processors begin processing.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)