Input stream partition to task mapping

[Ueli Gallizzi <ue...@gmail.com>]

Hi,

Is it possible that multiple tasks read from the same input stream
partition?

example:
task 0 stream A partition 0, stream B partition 0
task 1 stream A partition 1, stream B partition 0
task 2 stream A partition 3, stream B partition 0

In this example all messages in stream B partition 0 would be processed by
all 3 tasks.

Cheers,
- ueli

Re: Input stream partition to task mapping

[Yan Fang <ya...@gmail.com>]

Hi Ueli,

This feature currently is not supported by Samza. There was some
discussions in the JIRA - SAMZA-353
<https://issues.apache.org/jira/browse/SAMZA-353>.

But there are some workaround for this, depends on what you want to
achieve. If you can specify what your requirement is, we can help think of
the solution.

In another thread
<http://mail-archives.apache.org/mod_mbox/samza-dev/201504.mbox/%3C552410E2.7000100@tivo.com%3E>,
Tommy Becker has similar requirement and he maybe helpful as well.

Cheers,
Fang, Yan
yanfang724@gmail.com

On Tue, May 5, 2015 at 7:42 AM, Ueli Gallizzi <ue...@gmail.com>
wrote:

> Hi,
>
> Is it possible that multiple tasks read from the same input stream
> partition?
>
> example:
> task 0 stream A partition 0, stream B partition 0
> task 1 stream A partition 1, stream B partition 0
> task 2 stream A partition 3, stream B partition 0
>
> In this example all messages in stream B partition 0 would be processed by
> all 3 tasks.
>
> Cheers,
> - ueli
>