You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by Jeff Kinard <je...@thekinards.com> on 2024/10/16 17:28:33 UTC

ML for Beam YAML design proposal

Hi all,

As the Beam ML and Beam YAML frameworks and communities continue to grow,
there is a great opportunity to link these two together by introducing ML
capabilities to Beam YAML. By integrating ML capabilities into Beam YAML,
we can dramatically simplify the development and deployment of machine
learning pipelines. This integration will enable users to leverage the
power of Beam ML's rich transforms with little-to-no coding, reducing the
barrier of entry and accelerating innovation.

I have created a design proposal for how RunInference could be leveraged in
the Beam YAML syntax.

https://docs.google.com/document/d/1z9lNlSBfqDVdOP1frJNv_NJoMR1F1VBI29wn788x6IE

This is an exciting opportunity for the Beam community to collaborate and
shape the future of ML with Beam YAML. I encourage everyone to share their
ideas and help us build a powerful and user-friendly framework for machine
learning.

Thanks,
- Jeff

Re: ML for Beam YAML design proposal

Posted by Danny McCormick via dev <de...@beam.apache.org>.

Thanks, this LGTM and I think will be a nice addition here.

On Mon, Oct 28, 2024 at 12:25 PM Robert Bradshaw via dev <
dev@beam.apache.org> wrote:

> Thanks. It will be a great feature to be able to do (basic) ML in a
> low/no-code setting.
>
> On Wed, Oct 16, 2024 at 10:29 AM Jeff Kinard <je...@thekinards.com> wrote:
> >
> > Hi all,
> >
> > As the Beam ML and Beam YAML frameworks and communities continue to
> grow, there is a great opportunity to link these two together by
> introducing ML capabilities to Beam YAML. By integrating ML capabilities
> into Beam YAML, we can dramatically simplify the development and deployment
> of machine learning pipelines. This integration will enable users to
> leverage the power of Beam ML's rich transforms with little-to-no coding,
> reducing the barrier of entry and accelerating innovation.
> >
> > I have created a design proposal for how RunInference could be leveraged
> in the Beam YAML syntax.
> >
> >
> https://docs.google.com/document/d/1z9lNlSBfqDVdOP1frJNv_NJoMR1F1VBI29wn788x6IE
> >
> > This is an exciting opportunity for the Beam community to collaborate
> and shape the future of ML with Beam YAML. I encourage everyone to share
> their ideas and help us build a powerful and user-friendly framework for
> machine learning.
> >
> > Thanks,
> > - Jeff
>

Re: ML for Beam YAML design proposal

Posted by Robert Bradshaw via dev <de...@beam.apache.org>.

Thanks. It will be a great feature to be able to do (basic) ML in a
low/no-code setting.

On Wed, Oct 16, 2024 at 10:29 AM Jeff Kinard <je...@thekinards.com> wrote:
>
> Hi all,
>
> As the Beam ML and Beam YAML frameworks and communities continue to grow, there is a great opportunity to link these two together by introducing ML capabilities to Beam YAML. By integrating ML capabilities into Beam YAML, we can dramatically simplify the development and deployment of machine learning pipelines. This integration will enable users to leverage the power of Beam ML's rich transforms with little-to-no coding, reducing the barrier of entry and accelerating innovation.
>
> I have created a design proposal for how RunInference could be leveraged in the Beam YAML syntax.
>
> https://docs.google.com/document/d/1z9lNlSBfqDVdOP1frJNv_NJoMR1F1VBI29wn788x6IE
>
> This is an exciting opportunity for the Beam community to collaborate and shape the future of ML with Beam YAML. I encourage everyone to share their ideas and help us build a powerful and user-friendly framework for machine learning.
>
> Thanks,
> - Jeff