You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by Ankur Goenka <go...@google.com> on 2019/05/01 01:22:40 UTC

Re: Structured streaming based spark runner.

Exciting! Thanks Etienne for sharing the design and progress.

On Tue, Apr 30, 2019 at 10:11 AM Etienne Chauchot <ec...@apache.org>
wrote:

> Hi guys,
> As part of the ongoing work on spark runner POC based on structured
> streaming framework, I sketched up a design doc (1) to share context and
> design principles.
> Feel free to comment.
>
> [1]  <https://s.apache.org/spark-structured-streaming-runner>
> https://s.apache.org/spark-structured-streaming-runner
>
> Etienne
>

Re: Structured streaming based spark runner.

Posted by Kenneth Knowles <ke...@apache.org>.

Very cool. Took a look.

On Tue, Apr 30, 2019 at 6:23 PM Ankur Goenka <go...@google.com> wrote:

> Exciting! Thanks Etienne for sharing the design and progress.
>
> On Tue, Apr 30, 2019 at 10:11 AM Etienne Chauchot <ec...@apache.org>
> wrote:
>
>> Hi guys,
>> As part of the ongoing work on spark runner POC based on structured
>> streaming framework, I sketched up a design doc (1) to share context and
>> design principles.
>> Feel free to comment.
>>
>> [1]  <https://s.apache.org/spark-structured-streaming-runner>
>> https://s.apache.org/spark-structured-streaming-runner
>>
>> Etienne
>>
>