You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Xinyu Liu (JIRA)" <ji...@apache.org> on 2017/03/09 17:39:37 UTC

[jira] [Created] (SAMZA-1129) Add plugable CoordinationService

Xinyu Liu created SAMZA-1129:
--------------------------------

             Summary: Add plugable CoordinationService
                 Key: SAMZA-1129
                 URL: https://issues.apache.org/jira/browse/SAMZA-1129
             Project: Samza
          Issue Type: New Feature
            Reporter: Xinyu Liu
            Assignee: Boris Shkolnik


In the local deployment mode, coordination is needed for the following scenarios:

1) Coordination on the job level: we need leader elector to generate the job model, and a barrier for all the followers to receive the job model after generation.

2) Coordination on the app level: we need leader elector to generate the intermediate streams, and a latch for all the processors to start after that.

A plugable CoordinationService  can be shared for these use cases of group coordination. Samza will provide a Zk-based CoordinationService that can be used to construct the leader elector and latch.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)