You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Pierre Vanacker <pi...@dailymotion.com> on 2019/10/09 14:55:11 UTC
Feedback on how we use Apache Beam in my company
Hi Apache Beam community,
We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
Thanks to the developers for your great work !
Regards,
Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Aizhamal Nurmamat kyzy <ai...@google.com>.
Also great addition to https://github.com/pabloem/awesome-beam
On Fri, Oct 11, 2019 at 3:52 PM Pierre Vanacker <
pierre.vanacker@dailymotion.com> wrote:
> Nice, thanks. I just registered, see you there !
>
>
>
> Pierre
>
>
>
> *De : *Alexey Romanenko <ar...@gmail.com>
> *Répondre à : *"user@beam.apache.org" <us...@beam.apache.org>
> *Date : *vendredi 11 octobre 2019 à 15:29
> *À : *"user@beam.apache.org" <us...@beam.apache.org>
> *Cc : *dev <de...@beam.apache.org>
> *Objet : *Re: Feedback on how we use Apache Beam in my company
>
>
>
> Hi Pierre,
>
>
>
> If you are in Paris region (I can guess because of Dailymotion name =) )
> then it would be great to chat about that at next (2nd) Paris Beam meetup,
> which will be held very soon, *October 17th*.
>
> https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/
> <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.meetup.com%2FParis-Apache-Beam-Meetup%2Fevents%2F264545288%2F&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499436280&sdata=AbLRILt9Sg5rGF2m1UykuunIHAkCmJzueDbHZ8HPrKY%3D&reserved=0>
>
>
>
>
>
> On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com>
> wrote:
>
>
>
> Thanks Etienne & Matthias !
>
>
>
> Why not, it kinda depends on the location :) What meetup / summit do you
> have in mind ?
>
>
>
> Pierre
>
>
>
> *De : *Matthias Baetens <ba...@gmail.com>
> *Répondre à : *"user@beam.apache.org" <us...@beam.apache.org>
> *Date : *vendredi 11 octobre 2019 à 09:45
> *À : *"user@beam.apache.org" <us...@beam.apache.org>
> *Cc : *dev <de...@beam.apache.org>
> *Objet : *Re: Feedback on how we use Apache Beam in my company
>
>
>
> This is great, Pierre! Thank you for sharing, very interesting.
>
>
>
> Would you and your team be interested to talk about your use case at a
> meetup (or Summit) in the future? :)
>
>
>
> All the best,
>
> Matthias
>
>
>
> On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>
> wrote:
>
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
>
> On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
> <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499441272&sdata=0mwhScdt64hSvlmbsGt63jD9gdjThvel3%2F1aTCfSqIY%3D&reserved=0>
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
>
>
Re: Feedback on how we use Apache Beam in my company
Posted by Aizhamal Nurmamat kyzy <ai...@google.com>.
Also great addition to https://github.com/pabloem/awesome-beam
On Fri, Oct 11, 2019 at 3:52 PM Pierre Vanacker <
pierre.vanacker@dailymotion.com> wrote:
> Nice, thanks. I just registered, see you there !
>
>
>
> Pierre
>
>
>
> *De : *Alexey Romanenko <ar...@gmail.com>
> *Répondre à : *"user@beam.apache.org" <us...@beam.apache.org>
> *Date : *vendredi 11 octobre 2019 à 15:29
> *À : *"user@beam.apache.org" <us...@beam.apache.org>
> *Cc : *dev <de...@beam.apache.org>
> *Objet : *Re: Feedback on how we use Apache Beam in my company
>
>
>
> Hi Pierre,
>
>
>
> If you are in Paris region (I can guess because of Dailymotion name =) )
> then it would be great to chat about that at next (2nd) Paris Beam meetup,
> which will be held very soon, *October 17th*.
>
> https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/
> <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.meetup.com%2FParis-Apache-Beam-Meetup%2Fevents%2F264545288%2F&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499436280&sdata=AbLRILt9Sg5rGF2m1UykuunIHAkCmJzueDbHZ8HPrKY%3D&reserved=0>
>
>
>
>
>
> On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com>
> wrote:
>
>
>
> Thanks Etienne & Matthias !
>
>
>
> Why not, it kinda depends on the location :) What meetup / summit do you
> have in mind ?
>
>
>
> Pierre
>
>
>
> *De : *Matthias Baetens <ba...@gmail.com>
> *Répondre à : *"user@beam.apache.org" <us...@beam.apache.org>
> *Date : *vendredi 11 octobre 2019 à 09:45
> *À : *"user@beam.apache.org" <us...@beam.apache.org>
> *Cc : *dev <de...@beam.apache.org>
> *Objet : *Re: Feedback on how we use Apache Beam in my company
>
>
>
> This is great, Pierre! Thank you for sharing, very interesting.
>
>
>
> Would you and your team be interested to talk about your use case at a
> meetup (or Summit) in the future? :)
>
>
>
> All the best,
>
> Matthias
>
>
>
> On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>
> wrote:
>
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
>
> On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
> <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499441272&sdata=0mwhScdt64hSvlmbsGt63jD9gdjThvel3%2F1aTCfSqIY%3D&reserved=0>
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
>
>
Re: Feedback on how we use Apache Beam in my company
Posted by Pierre Vanacker <pi...@dailymotion.com>.
Nice, thanks. I just registered, see you there !
Pierre
De : Alexey Romanenko <ar...@gmail.com>
Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
Date : vendredi 11 octobre 2019 à 15:29
À : "user@beam.apache.org" <us...@beam.apache.org>
Cc : dev <de...@beam.apache.org>
Objet : Re: Feedback on how we use Apache Beam in my company
Hi Pierre,
If you are in Paris region (I can guess because of Dailymotion name =) ) then it would be great to chat about that at next (2nd) Paris Beam meetup, which will be held very soon, October 17th.
https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.meetup.com%2FParis-Apache-Beam-Meetup%2Fevents%2F264545288%2F&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499436280&sdata=AbLRILt9Sg5rGF2m1UykuunIHAkCmJzueDbHZ8HPrKY%3D&reserved=0>
On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com>> wrote:
Thanks Etienne & Matthias !
Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
Pierre
De : Matthias Baetens <ba...@gmail.com>>
Répondre à : "user@beam.apache.org<ma...@beam.apache.org>" <us...@beam.apache.org>>
Date : vendredi 11 octobre 2019 à 09:45
À : "user@beam.apache.org<ma...@beam.apache.org>" <us...@beam.apache.org>>
Cc : dev <de...@beam.apache.org>>
Objet : Re: Feedback on how we use Apache Beam in my company
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>> wrote:
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
Hi Apache Beam community,
We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499441272&sdata=0mwhScdt64hSvlmbsGt63jD9gdjThvel3%2F1aTCfSqIY%3D&reserved=0>
Thanks to the developers for your great work !
Regards,
Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Pierre Vanacker <pi...@dailymotion.com>.
Nice, thanks. I just registered, see you there !
Pierre
De : Alexey Romanenko <ar...@gmail.com>
Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
Date : vendredi 11 octobre 2019 à 15:29
À : "user@beam.apache.org" <us...@beam.apache.org>
Cc : dev <de...@beam.apache.org>
Objet : Re: Feedback on how we use Apache Beam in my company
Hi Pierre,
If you are in Paris region (I can guess because of Dailymotion name =) ) then it would be great to chat about that at next (2nd) Paris Beam meetup, which will be held very soon, October 17th.
https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.meetup.com%2FParis-Apache-Beam-Meetup%2Fevents%2F264545288%2F&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499436280&sdata=AbLRILt9Sg5rGF2m1UykuunIHAkCmJzueDbHZ8HPrKY%3D&reserved=0>
On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com>> wrote:
Thanks Etienne & Matthias !
Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
Pierre
De : Matthias Baetens <ba...@gmail.com>>
Répondre à : "user@beam.apache.org<ma...@beam.apache.org>" <us...@beam.apache.org>>
Date : vendredi 11 octobre 2019 à 09:45
À : "user@beam.apache.org<ma...@beam.apache.org>" <us...@beam.apache.org>>
Cc : dev <de...@beam.apache.org>>
Objet : Re: Feedback on how we use Apache Beam in my company
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>> wrote:
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
Hi Apache Beam community,
We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7C58192c313fea4c17197e08d74e4eff06%7C37530da3f7a748f4ba462dc336d55387%7C0%7C0%7C637063973499441272&sdata=0mwhScdt64hSvlmbsGt63jD9gdjThvel3%2F1aTCfSqIY%3D&reserved=0>
Thanks to the developers for your great work !
Regards,
Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Alexey Romanenko <ar...@gmail.com>.
Hi Pierre,
If you are in Paris region (I can guess because of Dailymotion name =) ) then it would be great to chat about that at next (2nd) Paris Beam meetup, which will be held very soon, October 17th.
https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/ <https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/>
> On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com> wrote:
>
> Thanks Etienne & Matthias !
>
> Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
>
> Pierre
>
> De : Matthias Baetens <ba...@gmail.com>
> Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
> Date : vendredi 11 octobre 2019 à 09:45
> À : "user@beam.apache.org" <us...@beam.apache.org>
> Cc : dev <de...@beam.apache.org>
> Objet : Re: Feedback on how we use Apache Beam in my company
>
> This is great, Pierre! Thank you for sharing, very interesting.
>
> Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
>
> All the best,
> Matthias
>
> On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <echauchot@apache.org <ma...@apache.org>> wrote:
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
>
> On 09/10/2019 16:55, Pierre Vanacker wrote:
> Hi Apache Beam community,
>
> We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
>
> If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816 <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7Cb59077d341534247d31508d74e1f0815%7C37530da3f7a748f4ba462dc336d55387%7C0%7C1%7C637063767500015852&sdata=yaJtr3y4ceu%2Bw1gdHgkdSeTuSOxjoZi1U6iLvWBCf2o%3D&reserved=0>
>
> Thanks to the developers for your great work !
>
> Regards,
>
> Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Alexey Romanenko <ar...@gmail.com>.
Hi Pierre,
If you are in Paris region (I can guess because of Dailymotion name =) ) then it would be great to chat about that at next (2nd) Paris Beam meetup, which will be held very soon, October 17th.
https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/ <https://www.meetup.com/Paris-Apache-Beam-Meetup/events/264545288/>
> On 11 Oct 2019, at 14:58, Pierre Vanacker <pi...@dailymotion.com> wrote:
>
> Thanks Etienne & Matthias !
>
> Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
>
> Pierre
>
> De : Matthias Baetens <ba...@gmail.com>
> Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
> Date : vendredi 11 octobre 2019 à 09:45
> À : "user@beam.apache.org" <us...@beam.apache.org>
> Cc : dev <de...@beam.apache.org>
> Objet : Re: Feedback on how we use Apache Beam in my company
>
> This is great, Pierre! Thank you for sharing, very interesting.
>
> Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
>
> All the best,
> Matthias
>
> On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <echauchot@apache.org <ma...@apache.org>> wrote:
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
>
> On 09/10/2019 16:55, Pierre Vanacker wrote:
> Hi Apache Beam community,
>
> We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
>
> If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816 <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7Cb59077d341534247d31508d74e1f0815%7C37530da3f7a748f4ba462dc336d55387%7C0%7C1%7C637063767500015852&sdata=yaJtr3y4ceu%2Bw1gdHgkdSeTuSOxjoZi1U6iLvWBCf2o%3D&reserved=0>
>
> Thanks to the developers for your great work !
>
> Regards,
>
> Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Pierre Vanacker <pi...@dailymotion.com>.
Thanks Etienne & Matthias !
Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
Pierre
De : Matthias Baetens <ba...@gmail.com>
Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
Date : vendredi 11 octobre 2019 à 09:45
À : "user@beam.apache.org" <us...@beam.apache.org>
Cc : dev <de...@beam.apache.org>
Objet : Re: Feedback on how we use Apache Beam in my company
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>> wrote:
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
Hi Apache Beam community,
We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7Cb59077d341534247d31508d74e1f0815%7C37530da3f7a748f4ba462dc336d55387%7C0%7C1%7C637063767500015852&sdata=yaJtr3y4ceu%2Bw1gdHgkdSeTuSOxjoZi1U6iLvWBCf2o%3D&reserved=0>
Thanks to the developers for your great work !
Regards,
Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Pierre Vanacker <pi...@dailymotion.com>.
Thanks Etienne & Matthias !
Why not, it kinda depends on the location :) What meetup / summit do you have in mind ?
Pierre
De : Matthias Baetens <ba...@gmail.com>
Répondre à : "user@beam.apache.org" <us...@beam.apache.org>
Date : vendredi 11 octobre 2019 à 09:45
À : "user@beam.apache.org" <us...@beam.apache.org>
Cc : dev <de...@beam.apache.org>
Objet : Re: Feedback on how we use Apache Beam in my company
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org>> wrote:
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
Hi Apache Beam community,
We’ve been working with Apache Beam in production for a few years now in my company (Dailymotion).
If you’re interested to know how we use Apache Beam in combination with Google Dataflow, we shared this experience in the following article : https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Fdailymotion%2Frealtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816&data=02%7C01%7Cpierre.vanacker%40dailymotion.com%7Cb59077d341534247d31508d74e1f0815%7C37530da3f7a748f4ba462dc336d55387%7C0%7C1%7C637063767500015852&sdata=yaJtr3y4ceu%2Bw1gdHgkdSeTuSOxjoZi1U6iLvWBCf2o%3D&reserved=0>
Thanks to the developers for your great work !
Regards,
Pierre
Re: Feedback on how we use Apache Beam in my company
Posted by Matthias Baetens <ba...@gmail.com>.
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a
meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org> wrote:
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
> On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
>
Re: Feedback on how we use Apache Beam in my company
Posted by Matthias Baetens <ba...@gmail.com>.
This is great, Pierre! Thank you for sharing, very interesting.
Would you and your team be interested to talk about your use case at a
meetup (or Summit) in the future? :)
All the best,
Matthias
On Wed, 9 Oct 2019 at 15:59, Etienne Chauchot <ec...@apache.org> wrote:
> Very nice !
>
> Thanks
>
> ccing dev list
>
> Etienne
> On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
>
Re: Feedback on how we use Apache Beam in my company
Posted by Etienne Chauchot <ec...@apache.org>.
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
> We’ve been working with Apache Beam in production for a few years now
> in my company (Dailymotion).
>
> If you’re interested to know how we use Apache Beam in combination
> with Google Dataflow, we shared this experience in the following
> article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
> Thanks to the developers for your great work !
>
> Regards,
>
> Pierre
>
Re: Feedback on how we use Apache Beam in my company
Posted by Alex Van Boxel <al...@vanboxel.be>.
Great writeup. You can add an additional benefit of docker vs templates:
Dynamically reconfigure/rebuild your pipelines from external parameters
(example arguments), iso only using the Value placeholders.
_/
_/ Alex Van Boxel
On Wed, Oct 9, 2019 at 4:55 PM Pierre Vanacker <
pierre.vanacker@dailymotion.com> wrote:
> Hi Apache Beam community,
>
>
>
> We’ve been working with Apache Beam in production for a few years now in
> my company (Dailymotion).
>
>
>
> If you’re interested to know how we use Apache Beam in combination with
> Google Dataflow, we shared this experience in the following article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
>
>
> Thanks to the developers for your great work !
>
>
>
> Regards,
>
>
>
> Pierre
>
Re: Feedback on how we use Apache Beam in my company
Posted by Etienne Chauchot <ec...@apache.org>.
Very nice !
Thanks
ccing dev list
Etienne
On 09/10/2019 16:55, Pierre Vanacker wrote:
>
> Hi Apache Beam community,
>
> We’ve been working with Apache Beam in production for a few years now
> in my company (Dailymotion).
>
> If you’re interested to know how we use Apache Beam in combination
> with Google Dataflow, we shared this experience in the following
> article :
> https://medium.com/dailymotion/realtime-data-processing-with-apache-beam-and-google-dataflow-at-dailymotion-7d1b994dc816
>
> Thanks to the developers for your great work !
>
> Regards,
>
> Pierre
>