You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Lei Xu <le...@getcruise.com> on 2019/04/15 21:38:20 UTC

Re: [EXT] Re: [DOC] Portable Spark Runner

This is super nice! Really look forward to use this.

On Mon, Apr 15, 2019 at 2:34 PM Thomas Weise <th...@apache.org> wrote:

> Great to see the portable Spark runner taking shape. Thanks for the update!
>
>
> On Mon, Apr 15, 2019 at 10:53 AM Pablo Estrada <pa...@google.com> wrote:
>
>> This is very cool Kyle. Thanks for moving it forward!
>> Best
>> -P.
>>
>> On Fri, Apr 12, 2019 at 1:21 PM Lukasz Cwik <lc...@google.com> wrote:
>>
>>> Thanks for the doc.
>>>
>>> On Fri, Apr 12, 2019 at 11:34 AM Kyle Weaver <kc...@google.com>
>>> wrote:
>>>
>>>> Hi everyone,
>>>>
>>>> As some of you know, I've been piggybacking on the existing Spark and
>>>> Flink runners to create a portable version of the Spark runner. I wrote up
>>>> a summary of the work I've done so far and what remains to be done. I'll
>>>> keep updating this going forward to provide a reasonably up-to-date
>>>> description of the state of the project. Please comment on the doc if you
>>>> have any thoughts.
>>>>
>>>> Link:
>>>>
>>>> https://docs.google.com/document/d/1j8GERTiHUuc6CzzCXZHc38rBn41uWfATBh2-5JN8hro/edit?usp=sharing
>>>>
>>>> Thanks,
>>>> Kyle
>>>>
>>>> Kyle Weaver |  Software Engineer | github.com/ibzib |
>>>> kcweaver@google.com |  +16502035555
>>>>
>>>

-- 


*Confidentiality Note:* We care about protecting our proprietary 
information, confidential material, and trade secrets. This message may 
contain some or all of those things. Cruise will suffer material harm if 
anyone other than the intended recipient disseminates or takes any action 
based on this message. If you have received this message (including any 
attachments) in error, please delete it immediately and notify the sender 
promptly.

Re: [EXT] Re: [DOC] Portable Spark Runner

Posted by Ismaël Mejía <ie...@gmail.com>.
Thanks for sharing, the diagram really helps to understand.
Please consider adding it to the design documents webpage.
https://beam.apache.org/contribute/design-documents/


On Tue, Apr 16, 2019 at 12:00 AM Ankur Goenka <go...@google.com> wrote:

> Thanks for sharing.
> This looks great!
>
> On Mon, Apr 15, 2019 at 2:54 PM Kenneth Knowles <ke...@apache.org> wrote:
>
>> Great. Thanks for sharing!
>>
>> On Mon, Apr 15, 2019 at 2:38 PM Lei Xu <le...@getcruise.com> wrote:
>>
>>> This is super nice! Really look forward to use this.
>>>
>>> On Mon, Apr 15, 2019 at 2:34 PM Thomas Weise <th...@apache.org> wrote:
>>>
>>>> Great to see the portable Spark runner taking shape. Thanks for the
>>>> update!
>>>>
>>>>
>>>> On Mon, Apr 15, 2019 at 10:53 AM Pablo Estrada <pa...@google.com>
>>>> wrote:
>>>>
>>>>> This is very cool Kyle. Thanks for moving it forward!
>>>>> Best
>>>>> -P.
>>>>>
>>>>> On Fri, Apr 12, 2019 at 1:21 PM Lukasz Cwik <lc...@google.com> wrote:
>>>>>
>>>>>> Thanks for the doc.
>>>>>>
>>>>>> On Fri, Apr 12, 2019 at 11:34 AM Kyle Weaver <kc...@google.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi everyone,
>>>>>>>
>>>>>>> As some of you know, I've been piggybacking on the existing Spark
>>>>>>> and Flink runners to create a portable version of the Spark runner. I wrote
>>>>>>> up a summary of the work I've done so far and what remains to be done. I'll
>>>>>>> keep updating this going forward to provide a reasonably up-to-date
>>>>>>> description of the state of the project. Please comment on the doc if you
>>>>>>> have any thoughts.
>>>>>>>
>>>>>>> Link:
>>>>>>>
>>>>>>> https://docs.google.com/document/d/1j8GERTiHUuc6CzzCXZHc38rBn41uWfATBh2-5JN8hro/edit?usp=sharing
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Kyle
>>>>>>>
>>>>>>> Kyle Weaver |  Software Engineer | github.com/ibzib |
>>>>>>> kcweaver@google.com |  +16502035555
>>>>>>>
>>>>>>
>>>
>>> *Confidentiality Note:* We care about protecting our proprietary
>>> information, confidential material, and trade secrets. This message may
>>> contain some or all of those things. Cruise will suffer material harm if
>>> anyone other than the intended recipient disseminates or takes any action
>>> based on this message. If you have received this message (including any
>>> attachments) in error, please delete it immediately and notify the sender
>>> promptly.
>>
>>

Re: [EXT] Re: [DOC] Portable Spark Runner

Posted by Ankur Goenka <go...@google.com>.
Thanks for sharing.
This looks great!

On Mon, Apr 15, 2019 at 2:54 PM Kenneth Knowles <ke...@apache.org> wrote:

> Great. Thanks for sharing!
>
> On Mon, Apr 15, 2019 at 2:38 PM Lei Xu <le...@getcruise.com> wrote:
>
>> This is super nice! Really look forward to use this.
>>
>> On Mon, Apr 15, 2019 at 2:34 PM Thomas Weise <th...@apache.org> wrote:
>>
>>> Great to see the portable Spark runner taking shape. Thanks for the
>>> update!
>>>
>>>
>>> On Mon, Apr 15, 2019 at 10:53 AM Pablo Estrada <pa...@google.com>
>>> wrote:
>>>
>>>> This is very cool Kyle. Thanks for moving it forward!
>>>> Best
>>>> -P.
>>>>
>>>> On Fri, Apr 12, 2019 at 1:21 PM Lukasz Cwik <lc...@google.com> wrote:
>>>>
>>>>> Thanks for the doc.
>>>>>
>>>>> On Fri, Apr 12, 2019 at 11:34 AM Kyle Weaver <kc...@google.com>
>>>>> wrote:
>>>>>
>>>>>> Hi everyone,
>>>>>>
>>>>>> As some of you know, I've been piggybacking on the existing Spark and
>>>>>> Flink runners to create a portable version of the Spark runner. I wrote up
>>>>>> a summary of the work I've done so far and what remains to be done. I'll
>>>>>> keep updating this going forward to provide a reasonably up-to-date
>>>>>> description of the state of the project. Please comment on the doc if you
>>>>>> have any thoughts.
>>>>>>
>>>>>> Link:
>>>>>>
>>>>>> https://docs.google.com/document/d/1j8GERTiHUuc6CzzCXZHc38rBn41uWfATBh2-5JN8hro/edit?usp=sharing
>>>>>>
>>>>>> Thanks,
>>>>>> Kyle
>>>>>>
>>>>>> Kyle Weaver |  Software Engineer | github.com/ibzib |
>>>>>> kcweaver@google.com |  +16502035555
>>>>>>
>>>>>
>>
>> *Confidentiality Note:* We care about protecting our proprietary
>> information, confidential material, and trade secrets. This message may
>> contain some or all of those things. Cruise will suffer material harm if
>> anyone other than the intended recipient disseminates or takes any action
>> based on this message. If you have received this message (including any
>> attachments) in error, please delete it immediately and notify the sender
>> promptly.
>
>

Re: [EXT] Re: [DOC] Portable Spark Runner

Posted by Kenneth Knowles <ke...@apache.org>.
Great. Thanks for sharing!

On Mon, Apr 15, 2019 at 2:38 PM Lei Xu <le...@getcruise.com> wrote:

> This is super nice! Really look forward to use this.
>
> On Mon, Apr 15, 2019 at 2:34 PM Thomas Weise <th...@apache.org> wrote:
>
>> Great to see the portable Spark runner taking shape. Thanks for the
>> update!
>>
>>
>> On Mon, Apr 15, 2019 at 10:53 AM Pablo Estrada <pa...@google.com>
>> wrote:
>>
>>> This is very cool Kyle. Thanks for moving it forward!
>>> Best
>>> -P.
>>>
>>> On Fri, Apr 12, 2019 at 1:21 PM Lukasz Cwik <lc...@google.com> wrote:
>>>
>>>> Thanks for the doc.
>>>>
>>>> On Fri, Apr 12, 2019 at 11:34 AM Kyle Weaver <kc...@google.com>
>>>> wrote:
>>>>
>>>>> Hi everyone,
>>>>>
>>>>> As some of you know, I've been piggybacking on the existing Spark and
>>>>> Flink runners to create a portable version of the Spark runner. I wrote up
>>>>> a summary of the work I've done so far and what remains to be done. I'll
>>>>> keep updating this going forward to provide a reasonably up-to-date
>>>>> description of the state of the project. Please comment on the doc if you
>>>>> have any thoughts.
>>>>>
>>>>> Link:
>>>>>
>>>>> https://docs.google.com/document/d/1j8GERTiHUuc6CzzCXZHc38rBn41uWfATBh2-5JN8hro/edit?usp=sharing
>>>>>
>>>>> Thanks,
>>>>> Kyle
>>>>>
>>>>> Kyle Weaver |  Software Engineer | github.com/ibzib |
>>>>> kcweaver@google.com |  +16502035555
>>>>>
>>>>
>
> *Confidentiality Note:* We care about protecting our proprietary
> information, confidential material, and trade secrets. This message may
> contain some or all of those things. Cruise will suffer material harm if
> anyone other than the intended recipient disseminates or takes any action
> based on this message. If you have received this message (including any
> attachments) in error, please delete it immediately and notify the sender
> promptly.