You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/06/02 07:52:04 UTC
[jira] [Commented] (SAMZA-1271) Guarantee deterministic and
predictable order for operator function initialization
[ https://issues.apache.org/jira/browse/SAMZA-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034297#comment-16034297 ]
ASF GitHub Bot commented on SAMZA-1271:
---------------------------------------
GitHub user vjagadish1989 opened a pull request:
https://github.com/apache/samza/pull/211
SAMZA-1271: Guarantee predictable, deterministic order for operator initialization and finalization
Currently, the order of initialization of operators in the Samza high level API is not deterministic. The non-determinism arises from two primary causes:
- No fixed order of iteration for all subscribed `OperatorSpec`s for a given `MessageStream`
- No fixed order of iteration for all the `OperatorImpl`s in the `OperatorImplGraph`
We aim to provide the following 2 guarantees in this patch:
For any 2 operators A, B in the graph, if B consumes the output of A:
- A is initialized before B is initialized
- A is finalized only after B is finalized
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vjagadish1989/samza deterministic_order
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/211.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #211
----
commit 95dde24595702748ac4d448fb528a3c3bb8c43da
Author: vjagadish1989 <jv...@linkedin.com>
Date: 2017-06-02T07:29:03Z
Guarantee deterministic order for operator initialization and finalization
----
> Guarantee deterministic and predictable order for operator function initialization
> ----------------------------------------------------------------------------------
>
> Key: SAMZA-1271
> URL: https://issues.apache.org/jira/browse/SAMZA-1271
> Project: Samza
> Issue Type: Bug
> Reporter: Prateek Maheshwari
> Assignee: Prateek Maheshwari
> Fix For: 0.14.0
>
>
> Should also update InitableFunction documentation to clarify the initialization order.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)