You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@heron.apache.org by Ning Wang <wa...@gmail.com> on 2018/06/09 00:08:29 UTC
ML in Heron weekly meeting
Brief notes for today's meeting:
- Review DD:
https://docs.google.com/document/d/1LrO7XRcMxJoMM83wjRd-Ov74VAaomA_mXOAhCStgGng/edit
- We want to understand better about the bigger picture of ML in stream
processing systems.
-- talk to ML users
-- doc of related systems to read:
---
https://mapr.com/blog/monitoring-real-time-uber-data-using-spark-machine-learning-streaming-and-kafka-api-part-2/
---
https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html
--- https://eng.uber.com/michelangelo/
Re: ML in Heron weekly meeting
Posted by Saikat Kanjilal <sx...@hotmail.com>.
Hi Dave,
The Samoa piece is a bit tricky, the goal essentially is to take their storm components and enhance them to work within the heron storm subcomponent and eventually with heron streamlet architecture. We chose Samoa because they have already built several machine learning topologies within storm.
Cheers
Sent from my iPhone
> On Jun 8, 2018, at 5:27 PM, Dave Fisher <da...@comcast.net> wrote:
>
>
>
> Sent from my iPhone
>
>> On Jun 8, 2018, at 5:08 PM, Ning Wang <wa...@gmail.com> wrote:
>>
>> Brief notes for today's meeting:
>>
>> - Review DD:
>> https://docs.google.com/document/d/1LrO7XRcMxJoMM83wjRd-Ov74VAaomA_mXOAhCStgGng/edit
>
> The document says copying Samoa. Heron should be working with the Samoa team and being careful not to fork.
>
>
>> - We want to understand better about the bigger picture of ML in stream
>> processing systems.
>> -- talk to ML users
>> -- doc of related systems to read:
>> ---
>> https://mapr.com/blog/monitoring-real-time-uber-data-using-spark-machine-learning-streaming-and-kafka-api-part-2/
>> ---
>> https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html
>> --- https://eng.uber.com/michelangelo/
>
> In addition to talking to the vendors who are powered by Apache Spark, directly talk to Apache Spark and Apache Kafka.
>
> My 2cents.
>
> Regards,
> Dave
Re: ML in Heron weekly meeting
Posted by Dave Fisher <da...@comcast.net>.
Sent from my iPhone
> On Jun 8, 2018, at 5:08 PM, Ning Wang <wa...@gmail.com> wrote:
>
> Brief notes for today's meeting:
>
> - Review DD:
> https://docs.google.com/document/d/1LrO7XRcMxJoMM83wjRd-Ov74VAaomA_mXOAhCStgGng/edit
The document says copying Samoa. Heron should be working with the Samoa team and being careful not to fork.
> - We want to understand better about the bigger picture of ML in stream
> processing systems.
> -- talk to ML users
> -- doc of related systems to read:
> ---
> https://mapr.com/blog/monitoring-real-time-uber-data-using-spark-machine-learning-streaming-and-kafka-api-part-2/
> ---
> https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html
> --- https://eng.uber.com/michelangelo/
In addition to talking to the vendors who are powered by Apache Spark, directly talk to Apache Spark and Apache Kafka.
My 2cents.
Regards,
Dave