[jira] [Created] (SAMZA-355) Provide a SystemStreamPartitionGrouper that groups into N sets

["Jakob Homan (JIRA)" <ji...@apache.org>]

Jakob Homan created SAMZA-355:
---------------------------------

             Summary: Provide a SystemStreamPartitionGrouper that groups into N sets
                 Key: SAMZA-355
                 URL: https://issues.apache.org/jira/browse/SAMZA-355
             Project: Samza
          Issue Type: Task
          Components: container
    Affects Versions: 0.8.0
            Reporter: Jakob Homan
         Attachments: SAMZA-355.patch

As part of SAMZA-123, it was proposed to provide an SSPGrouper that would hash the SSPs into a fixed number of tasknames.  This would provide similar, not-at-all-grouped functionality as the GroupByPartitionGrouper but with only n TaskInstances created rather than one for each SSP.  If that n is tied to the number of containers, this is a conceptually simple way of processing lots of SSPs that need no co-grouping.  

As long as the n is not changed, the SSPs would be guaranteed to hash to the same TaskName with each run.

There was some concern over if this is the correct approach to take, so it was agreed to post the patch separately and make it available to the community and for further discussion.



--
This message was sent by Atlassian JIRA
(v6.2#6252)