You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Jack McCluskey via dev <de...@beam.apache.org> on 2023/05/30 18:42:03 UTC
Client-Side Throttling in Apache Beam
Hey everyone,
While working on some remote model handler code I hit a point where I
needed to understand how Beam IOs interpret and action on being throttled
by an external service. This turned into a few discussions and then a small
write-up doc (
https://docs.google.com/document/d/1ePorJGZnLbNCmLD9mR7iFYOdPsyDA1rDnTpYnbdrzSU/edit?usp=sharing)
to encapsulate the basics of what I learned. If you're familiar with this
topic feel free to make suggestions on the doc, I'm intending to add this
to the wiki so there's a resource for how this works in the future!
Thanks,
Jack McCluskey
--
Jack McCluskey
SWE - DataPLS PLAT/ Dataflow ML
RDU
jrmccluskey@google.com
Re: Client-Side Throttling in Apache Beam
Posted by Ahmet Altay via dev <de...@beam.apache.org>.
Thank you. +1 to adding this to wiki.
FYI - @Damon Douglas <da...@google.com> shared a related doc earlier
for alternative ideas for Beam to prevent overloading external services. (
https://docs.google.com/document/d/1VZ9YphDO7kewBSz5oMXVPHWaib3S03Z6aZ66BhciB3E/edit?usp=sharing&resourcekey=0-ItxMSG72EzfSwVedSz-Zeg
)
On Tue, May 30, 2023 at 3:52 PM Robert Burke <ro...@frantil.com> wrote:
> Great article!
>
> Though it's depressing to see we have a pair of magic counter names to
> help modulate scaling behavior.
>
> On Tue, May 30, 2023, 11:42 AM Jack McCluskey via dev <de...@beam.apache.org>
> wrote:
>
>> Hey everyone,
>>
>> While working on some remote model handler code I hit a point where I
>> needed to understand how Beam IOs interpret and action on being throttled
>> by an external service. This turned into a few discussions and then a small
>> write-up doc (
>> https://docs.google.com/document/d/1ePorJGZnLbNCmLD9mR7iFYOdPsyDA1rDnTpYnbdrzSU/edit?usp=sharing)
>> to encapsulate the basics of what I learned. If you're familiar with this
>> topic feel free to make suggestions on the doc, I'm intending to add this
>> to the wiki so there's a resource for how this works in the future!
>>
>> Thanks,
>>
>> Jack McCluskey
>>
>> --
>>
>>
>> Jack McCluskey
>> SWE - DataPLS PLAT/ Dataflow ML
>> RDU
>> jrmccluskey@google.com
>>
>>
>>
Re: Client-Side Throttling in Apache Beam
Posted by Robert Burke <ro...@frantil.com>.
Great article!
Though it's depressing to see we have a pair of magic counter names to help
modulate scaling behavior.
On Tue, May 30, 2023, 11:42 AM Jack McCluskey via dev <de...@beam.apache.org>
wrote:
> Hey everyone,
>
> While working on some remote model handler code I hit a point where I
> needed to understand how Beam IOs interpret and action on being throttled
> by an external service. This turned into a few discussions and then a small
> write-up doc (
> https://docs.google.com/document/d/1ePorJGZnLbNCmLD9mR7iFYOdPsyDA1rDnTpYnbdrzSU/edit?usp=sharing)
> to encapsulate the basics of what I learned. If you're familiar with this
> topic feel free to make suggestions on the doc, I'm intending to add this
> to the wiki so there's a resource for how this works in the future!
>
> Thanks,
>
> Jack McCluskey
>
> --
>
>
> Jack McCluskey
> SWE - DataPLS PLAT/ Dataflow ML
> RDU
> jrmccluskey@google.com
>
>
>