You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by Adalbert Makarovych <am...@singlestore.com> on 2022/09/07 09:34:53 UTC

SingleStore IO design doc

Hi,

I'm working on the SingleStore IO connector.
Here <https://github.com/apache/beam/issues/22617> is a GitHub task for it.
It is going to be a large change, so I created a design doc
<https://docs.google.com/document/d/1WU-hkoZ93SaGXyOz_UtX0jXzIRl194hCId_IdmEV9jw/edit?usp=sharing>
for it.
I would appreciate any review/comments regarding it :)

-- 
Adalbert Makarovych
Software Engineer at SingleStore

<https://www.singlestore.com/customers/?utm_source=singlestore&utm_medium=email&utm_campaign=1-on-trustradius>

Re: SingleStore IO design doc

Posted by Kenneth Knowles <ke...@apache.org>.

Thanks for sharing the doc! Two big picture thoughts I had were:

1. Portability first
2. SDF first

Both of these are just ideas to take advantage of Beam's unique features.
Happy for the contribution no matter what!

Kenn

On Wed, Sep 7, 2022 at 7:21 AM John Casey via dev <de...@beam.apache.org>
wrote:

> Hi Adalbert,
>
> This looks good. I've added a few comments to consider.
>
> John
>
> On Wed, Sep 7, 2022 at 5:33 AM Adalbert Makarovych <
> amakarovych-ua@singlestore.com> wrote:
>
>> Hi,
>>
>> I'm working on the SingleStore IO connector.
>> Here <https://github.com/apache/beam/issues/22617> is a GitHub task for
>> it.
>> It is going to be a large change, so I created a design doc
>> <https://docs.google.com/document/d/1WU-hkoZ93SaGXyOz_UtX0jXzIRl194hCId_IdmEV9jw/edit?usp=sharing>
>> for it.
>> I would appreciate any review/comments regarding it :)
>>
>> --
>> Adalbert Makarovych
>> Software Engineer at SingleStore
>>
>>
>> <https://www.singlestore.com/customers/?utm_source=singlestore&utm_medium=email&utm_campaign=1-on-trustradius>
>>
>

Re: SingleStore IO design doc

Posted by John Casey via dev <de...@beam.apache.org>.

Hi Adalbert,

This looks good. I've added a few comments to consider.

John

On Wed, Sep 7, 2022 at 5:33 AM Adalbert Makarovych <
amakarovych-ua@singlestore.com> wrote:

> Hi,
>
> I'm working on the SingleStore IO connector.
> Here <https://github.com/apache/beam/issues/22617> is a GitHub task for
> it.
> It is going to be a large change, so I created a design doc
> <https://docs.google.com/document/d/1WU-hkoZ93SaGXyOz_UtX0jXzIRl194hCId_IdmEV9jw/edit?usp=sharing>
> for it.
> I would appreciate any review/comments regarding it :)
>
> --
> Adalbert Makarovych
> Software Engineer at SingleStore
>
>
> <https://www.singlestore.com/customers/?utm_source=singlestore&utm_medium=email&utm_campaign=1-on-trustradius>
>