You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Chris Riccomini (JIRA)" <ji...@apache.org> on 2013/10/28 19:20:37 UTC
[jira] [Created] (SAMZA-67) Maintain alignment in streams when
using the DefaultChooser
Chris Riccomini created SAMZA-67:
------------------------------------
Summary: Maintain alignment in streams when using the DefaultChooser
Key: SAMZA-67
URL: https://issues.apache.org/jira/browse/SAMZA-67
Project: Samza
Issue Type: New Feature
Components: container
Affects Versions: 0.6.0
Reporter: Chris Riccomini
The DefaultChooser currently defaults to a RoundRobinChooser when no chooser is specified in config. This means that, by default, we just round robin over which stream's messages to process next.
It might be possible to come up with a better strategy than round robin in this scenario. This problem is outlined in detail in:
https://wiki.apache.org/samza/Pluggable%20MessageChooser
The most interesting and intuitive strategy seems to be to try and maintain the alignment of the streams at the time the job starts (the fourth strategy outlined in the wiki proposal).
Also, see SAMZA-2 for more discussion on this.
--
This message was sent by Atlassian JIRA
(v6.1#6144)