Samoa and Beam

[Austin Bennett <wh...@gmail.com>]

Hi Samoa Dev,

It has struck some of us in the Apache Beam (https://beam.apache.org) community
that we have complimentary if not overlapping projects in many respects.
We were discussing yesterday that Beam is trying to handle the ability to
be cross DPSEe (SAMOA term), though more generally handle the compute on
top of a number of 'runners' (beam term).  Many of us have strong ML
interests, and around Streaming ML.

We were starting to brainstorm around how these projects could play well
together.  Prior to implementing things, the thought was to reach out to
learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
project updates, and haven't seen code pushed in awhile.

Has anyone in the Samoa community thought much on this?  Are people
following this mailing list?

Thanks,
Austin

Re: Samoa and Beam

[Dennis Jung <in...@gmail.com>]

Austin,
3~4 month before, dev team comment on mail that this project will go on in
a few month, but couldn't found additional action or reply from now.
But maybe they could be watching...so how about sharing your plan in this
mail?

Thanks.

2018년 8월 2일 (목) 오전 3:35, Austin Bennett <wh...@gmail.com>님이 작성:

> Hi Samoa Dev,
>
> It has struck some of us in the Apache Beam (https://beam.apache.org)
> community
> that we have complimentary if not overlapping projects in many respects.
> We were discussing yesterday that Beam is trying to handle the ability to
> be cross DPSEe (SAMOA term), though more generally handle the compute on
> top of a number of 'runners' (beam term).  Many of us have strong ML
> interests, and around Streaming ML.
>
> We were starting to brainstorm around how these projects could play well
> together.  Prior to implementing things, the thought was to reach out to
> learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
> project updates, and haven't seen code pushed in awhile.
>
> Has anyone in the Samoa community thought much on this?  Are people
> following this mailing list?
>
> Thanks,
> Austin
>

Re: Samoa and Beam

[Austin Bennett <wh...@gmail.com>]

Will do!


On Thu, Aug 9, 2018, 2:37 AM Gianmarco De Francisci Morales <gd...@apache.org>
wrote:

> Thanks Austin,
> Please do let us know what you come up with.
> We'll be happy to help if you need.
>
> Cheers,
>
> -- Gianmarco
>
> On Fri, Aug 3, 2018 at 11:09 PM, Austin Bennett <
> whatwouldaustindo@gmail.com
> > wrote:
>
> > Hi Gianmarco,
> >
> > I've only been speaking with a very small subset of Beam community, so do
> > not purport to represent overall.  There is a strong interest in ML by
> many
> > and certainly by me.  No specific 'project' at the moment -- just
> > enthusiasm from bits of ideas from varied exposures that tell me that the
> > two ideas/communities could do well together.
> >
> > I am a user of Beam (as far as developing it, have only contributed a
> small
> > bug fix up through now) though ML is an area I'd like to see more of
> > (though, my runners/DPSE are largely Spark and DataFlow on GCP which
> aren't
> > covered by Samoa) and it seems Beam helps address compute, so working
> with
> > it frees to focus on the development of Streaming/ML algs.  It actually
> > isn't 100% clear to me - at this point - how this will all work, so I
> have
> > plenty of HW to do.
> >
> > Given what I'm hearing, the best course of action seems to be for me to
> > just start hacking around on something that can leverage Beam and address
> > ML Algs.  It doesn't sound like that is an issue from the perspective of
> > animosity for stepping on your territory, or something like that.  Should
> > that gain a bit of traction, I will then look forward to figuring out
> > whether that might serve to bring the Beam and Samoa communities together
> > (also, in the meantime would let me get more up to speed with both, and
> > help me appreciate how difficult these problems really are).  I do have
> > some dev cycles to devote to this at the moment, so will aim to explore
> > further and see what can be built.  Will certainly be in touch with
> > updates!
> >
> > Cheers,
> > Austin
> >
> >
> > On Fri, Aug 3, 2018 at 10:38 AM, Gianmarco De Francisci Morales <
> > gdfm@apache.org> wrote:
> >
> > > Dear Austin,
> > >
> > > Thanks for your message.
> > > Indeed, we considered Beam at a certain point, but the project was
> still
> > > very young and it was not clear where it was headed.
> > > We could definitely re-consider it now that it has gained more
> traction.
> > > Are you starting to consider having Machine Learning algorithms inside
> > > Beam?
> > > We would be very happy to hear your thoughts and know a bit more about
> > the
> > > project.
> > >
> > > Regarding SAMOA, all the main developers currently do not have much
> time
> > to
> > > work on it, but we hope this might change in the next few months.
> > >
> > > Cheers,
> > >
> > >
> > >
> > > -- Gianmarco
> > >
> > > On Wed, Aug 1, 2018 at 8:35 PM, Austin Bennett <
> > > whatwouldaustindo@gmail.com>
> > > wrote:
> > >
> > > > Hi Samoa Dev,
> > > >
> > > > It has struck some of us in the Apache Beam (https://beam.apache.org
> )
> > > > community
> > > > that we have complimentary if not overlapping projects in many
> > respects.
> > > > We were discussing yesterday that Beam is trying to handle the
> ability
> > to
> > > > be cross DPSEe (SAMOA term), though more generally handle the compute
> > on
> > > > top of a number of 'runners' (beam term).  Many of us have strong ML
> > > > interests, and around Streaming ML.
> > > >
> > > > We were starting to brainstorm around how these projects could play
> > well
> > > > together.  Prior to implementing things, the thought was to reach out
> > to
> > > > learn of Samoa dev's thoughts.  It doesn't look like there are
> ongoing
> > > > project updates, and haven't seen code pushed in awhile.
> > > >
> > > > Has anyone in the Samoa community thought much on this?  Are people
> > > > following this mailing list?
> > > >
> > > > Thanks,
> > > > Austin
> > > >
> > >
> >
>

Re: Samoa and Beam

[Gianmarco De Francisci Morales <gd...@apache.org>]

Thanks Austin,
Please do let us know what you come up with.
We'll be happy to help if you need.

Cheers,

-- Gianmarco

On Fri, Aug 3, 2018 at 11:09 PM, Austin Bennett <whatwouldaustindo@gmail.com
> wrote:

> Hi Gianmarco,
>
> I've only been speaking with a very small subset of Beam community, so do
> not purport to represent overall.  There is a strong interest in ML by many
> and certainly by me.  No specific 'project' at the moment -- just
> enthusiasm from bits of ideas from varied exposures that tell me that the
> two ideas/communities could do well together.
>
> I am a user of Beam (as far as developing it, have only contributed a small
> bug fix up through now) though ML is an area I'd like to see more of
> (though, my runners/DPSE are largely Spark and DataFlow on GCP which aren't
> covered by Samoa) and it seems Beam helps address compute, so working with
> it frees to focus on the development of Streaming/ML algs.  It actually
> isn't 100% clear to me - at this point - how this will all work, so I have
> plenty of HW to do.
>
> Given what I'm hearing, the best course of action seems to be for me to
> just start hacking around on something that can leverage Beam and address
> ML Algs.  It doesn't sound like that is an issue from the perspective of
> animosity for stepping on your territory, or something like that.  Should
> that gain a bit of traction, I will then look forward to figuring out
> whether that might serve to bring the Beam and Samoa communities together
> (also, in the meantime would let me get more up to speed with both, and
> help me appreciate how difficult these problems really are).  I do have
> some dev cycles to devote to this at the moment, so will aim to explore
> further and see what can be built.  Will certainly be in touch with
> updates!
>
> Cheers,
> Austin
>
>
> On Fri, Aug 3, 2018 at 10:38 AM, Gianmarco De Francisci Morales <
> gdfm@apache.org> wrote:
>
> > Dear Austin,
> >
> > Thanks for your message.
> > Indeed, we considered Beam at a certain point, but the project was still
> > very young and it was not clear where it was headed.
> > We could definitely re-consider it now that it has gained more traction.
> > Are you starting to consider having Machine Learning algorithms inside
> > Beam?
> > We would be very happy to hear your thoughts and know a bit more about
> the
> > project.
> >
> > Regarding SAMOA, all the main developers currently do not have much time
> to
> > work on it, but we hope this might change in the next few months.
> >
> > Cheers,
> >
> >
> >
> > -- Gianmarco
> >
> > On Wed, Aug 1, 2018 at 8:35 PM, Austin Bennett <
> > whatwouldaustindo@gmail.com>
> > wrote:
> >
> > > Hi Samoa Dev,
> > >
> > > It has struck some of us in the Apache Beam (https://beam.apache.org)
> > > community
> > > that we have complimentary if not overlapping projects in many
> respects.
> > > We were discussing yesterday that Beam is trying to handle the ability
> to
> > > be cross DPSEe (SAMOA term), though more generally handle the compute
> on
> > > top of a number of 'runners' (beam term).  Many of us have strong ML
> > > interests, and around Streaming ML.
> > >
> > > We were starting to brainstorm around how these projects could play
> well
> > > together.  Prior to implementing things, the thought was to reach out
> to
> > > learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
> > > project updates, and haven't seen code pushed in awhile.
> > >
> > > Has anyone in the Samoa community thought much on this?  Are people
> > > following this mailing list?
> > >
> > > Thanks,
> > > Austin
> > >
> >
>

Re: Samoa and Beam

[Austin Bennett <wh...@gmail.com>]

Hi Gianmarco,

I've only been speaking with a very small subset of Beam community, so do
not purport to represent overall.  There is a strong interest in ML by many
and certainly by me.  No specific 'project' at the moment -- just
enthusiasm from bits of ideas from varied exposures that tell me that the
two ideas/communities could do well together.

I am a user of Beam (as far as developing it, have only contributed a small
bug fix up through now) though ML is an area I'd like to see more of
(though, my runners/DPSE are largely Spark and DataFlow on GCP which aren't
covered by Samoa) and it seems Beam helps address compute, so working with
it frees to focus on the development of Streaming/ML algs.  It actually
isn't 100% clear to me - at this point - how this will all work, so I have
plenty of HW to do.

Given what I'm hearing, the best course of action seems to be for me to
just start hacking around on something that can leverage Beam and address
ML Algs.  It doesn't sound like that is an issue from the perspective of
animosity for stepping on your territory, or something like that.  Should
that gain a bit of traction, I will then look forward to figuring out
whether that might serve to bring the Beam and Samoa communities together
(also, in the meantime would let me get more up to speed with both, and
help me appreciate how difficult these problems really are).  I do have
some dev cycles to devote to this at the moment, so will aim to explore
further and see what can be built.  Will certainly be in touch with
updates!

Cheers,
Austin


On Fri, Aug 3, 2018 at 10:38 AM, Gianmarco De Francisci Morales <
gdfm@apache.org> wrote:

> Dear Austin,
>
> Thanks for your message.
> Indeed, we considered Beam at a certain point, but the project was still
> very young and it was not clear where it was headed.
> We could definitely re-consider it now that it has gained more traction.
> Are you starting to consider having Machine Learning algorithms inside
> Beam?
> We would be very happy to hear your thoughts and know a bit more about the
> project.
>
> Regarding SAMOA, all the main developers currently do not have much time to
> work on it, but we hope this might change in the next few months.
>
> Cheers,
>
>
>
> -- Gianmarco
>
> On Wed, Aug 1, 2018 at 8:35 PM, Austin Bennett <
> whatwouldaustindo@gmail.com>
> wrote:
>
> > Hi Samoa Dev,
> >
> > It has struck some of us in the Apache Beam (https://beam.apache.org)
> > community
> > that we have complimentary if not overlapping projects in many respects.
> > We were discussing yesterday that Beam is trying to handle the ability to
> > be cross DPSEe (SAMOA term), though more generally handle the compute on
> > top of a number of 'runners' (beam term).  Many of us have strong ML
> > interests, and around Streaming ML.
> >
> > We were starting to brainstorm around how these projects could play well
> > together.  Prior to implementing things, the thought was to reach out to
> > learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
> > project updates, and haven't seen code pushed in awhile.
> >
> > Has anyone in the Samoa community thought much on this?  Are people
> > following this mailing list?
> >
> > Thanks,
> > Austin
> >
>

Re: Samoa and Beam

[Gianmarco De Francisci Morales <gd...@apache.org>]

Dear Austin,

Thanks for your message.
Indeed, we considered Beam at a certain point, but the project was still
very young and it was not clear where it was headed.
We could definitely re-consider it now that it has gained more traction.
Are you starting to consider having Machine Learning algorithms inside Beam?
We would be very happy to hear your thoughts and know a bit more about the
project.

Regarding SAMOA, all the main developers currently do not have much time to
work on it, but we hope this might change in the next few months.

Cheers,



-- Gianmarco

On Wed, Aug 1, 2018 at 8:35 PM, Austin Bennett <wh...@gmail.com>
wrote:

> Hi Samoa Dev,
>
> It has struck some of us in the Apache Beam (https://beam.apache.org)
> community
> that we have complimentary if not overlapping projects in many respects.
> We were discussing yesterday that Beam is trying to handle the ability to
> be cross DPSEe (SAMOA term), though more generally handle the compute on
> top of a number of 'runners' (beam term).  Many of us have strong ML
> interests, and around Streaming ML.
>
> We were starting to brainstorm around how these projects could play well
> together.  Prior to implementing things, the thought was to reach out to
> learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
> project updates, and haven't seen code pushed in awhile.
>
> Has anyone in the Samoa community thought much on this?  Are people
> following this mailing list?
>
> Thanks,
> Austin
>