You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zookeeper.apache.org by Huizhi Lu <hz...@apache.org> on 2021/01/19 08:49:10 UTC

Rate Quota

Hey ZK Experts,

I am actively looking into the request throttling/quota feature. I
recalled that at the zookeeper meetup, Facebook presented a rate quota
per client (see attached pic) feature. But I can't find it in any zk
doc or code. Is the feature available? If not, is there any reason?


Thanks!
-Huizhi

Re: Rate Quota

Posted by Li Wang <li...@gmail.com>.

Hi Huizhi,

Thank you so much for the picture. I am able to see the attachment.

Yes, let's keep following on it. The feature is very useful, especially in
a multi-tenant environment.

Is there any discussion or JIRA ticket for exposing quota related metrics
so the clients can monitor the quota usage and alert on the quota level?

Best,

Li



On Fri, Jan 22, 2021 at 6:26 PM Huizhi Lu <ih...@gmail.com> wrote:

> Thanks, Nobert, for the kind reply :)
>
> Li, here is the picture (I've uploaded it to github in case you can't
> see attachment):
>
> https://user-images.githubusercontent.com/5187721/105566039-cdca1480-5cde-11eb-8d8e-e28cb9c0c273.png
> We can keep following up on this feature. I think it's quite useful.
>
> On Fri, Jan 22, 2021 at 6:08 PM Li Wang <li...@gmail.com> wrote:
> >
> > Hi Huizhi,
> >
> > I am also looking for this rate quota per client feature. Would you mind
> > sending again the picture from the Facebook presentation, as I didn't see
> > that attachment.
> >
> > Thanks,
> >
> > Li
> >
> > On Wed, Jan 20, 2021 at 2:41 AM Norbert Kalmar
> <nk...@cloudera.com.invalid>
> > wrote:
> >
> > > Sorry, I missed the point there.
> > > Unfortunately I don't know the timeline for this feature. Our friends
> at
> > > Facebook weren't active lately, but hope you'll get an answer (I see
> you
> > > also asked on the jira).
> > >
> > > - Norbert
> > >
> > > On Tue, Jan 19, 2021 at 8:33 PM Huizhi Lu <ih...@gmail.com>
> wrote:
> > >
> > > > Hi Norbert,
> > > >
> > > > Thanks for the reply. I understand request throttling was added in
> the
> > > > ticket ZOOKEEPER-3243. My understanding is that it's a global request
> > > > throttling: total requests for all clients. But it is not a per
> client
> > > > level throttling.
> > > >
> > > > Just realized that the facebook presentation listed the zk ticket:
> > > > https://issues.apache.org/jira/browse/ZOOKEEPER-3467. I think this
> is
> > > > what I'm looking for: reads/s and writes/s for per client. The
> feature
> > > > is not yet available. I wonder if there is a timeline for it. Thanks!
> > > >
> > > >
> > > > -Huizhi
> > > >
> > > > On Tue, Jan 19, 2021 at 2:20 AM Norbert Kalmar
> > > > <nk...@cloudera.com.invalid> wrote:
> > > > >
> > > > > https://issues.apache.org/jira/browse/ZOOKEEPER-3243
> > > > >
> > > > > On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <
> nkalmar@cloudera.com>
> > > > > wrote:
> > > > >
> > > > > > Hi Huizhi,
> > > > > >
> > > > > > You might be looking for ZOOKEEPER-3243, it is available from
> 3.6.0.
> > > > > >
> > > > > > Regards,
> > > > > > Norbert
> > > > > >
> > > > > > On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org>
> wrote:
> > > > > >
> > > > > >> Hey ZK Experts,
> > > > > >>
> > > > > >> I am actively looking into the request throttling/quota
> feature. I
> > > > > >> recalled that at the zookeeper meetup, Facebook presented a rate
> > > quota
> > > > > >> per client (see attached pic) feature. But I can't find it in
> any zk
> > > > > >> doc or code. Is the feature available? If not, is there any
> reason?
> > > > > >>
> > > > > >>
> > > > > >> Thanks!
> > > > > >> -Huizhi
> > > > > >>
> > > > > >
> > > >
> > >
>

Re: Rate Quota

Posted by Huizhi Lu <ih...@gmail.com>.

Thanks, Nobert, for the kind reply :)

Li, here is the picture (I've uploaded it to github in case you can't
see attachment):
https://user-images.githubusercontent.com/5187721/105566039-cdca1480-5cde-11eb-8d8e-e28cb9c0c273.png
We can keep following up on this feature. I think it's quite useful.

On Fri, Jan 22, 2021 at 6:08 PM Li Wang <li...@gmail.com> wrote:
>
> Hi Huizhi,
>
> I am also looking for this rate quota per client feature. Would you mind
> sending again the picture from the Facebook presentation, as I didn't see
> that attachment.
>
> Thanks,
>
> Li
>
> On Wed, Jan 20, 2021 at 2:41 AM Norbert Kalmar <nk...@cloudera.com.invalid>
> wrote:
>
> > Sorry, I missed the point there.
> > Unfortunately I don't know the timeline for this feature. Our friends at
> > Facebook weren't active lately, but hope you'll get an answer (I see you
> > also asked on the jira).
> >
> > - Norbert
> >
> > On Tue, Jan 19, 2021 at 8:33 PM Huizhi Lu <ih...@gmail.com> wrote:
> >
> > > Hi Norbert,
> > >
> > > Thanks for the reply. I understand request throttling was added in the
> > > ticket ZOOKEEPER-3243. My understanding is that it's a global request
> > > throttling: total requests for all clients. But it is not a per client
> > > level throttling.
> > >
> > > Just realized that the facebook presentation listed the zk ticket:
> > > https://issues.apache.org/jira/browse/ZOOKEEPER-3467. I think this is
> > > what I'm looking for: reads/s and writes/s for per client. The feature
> > > is not yet available. I wonder if there is a timeline for it. Thanks!
> > >
> > >
> > > -Huizhi
> > >
> > > On Tue, Jan 19, 2021 at 2:20 AM Norbert Kalmar
> > > <nk...@cloudera.com.invalid> wrote:
> > > >
> > > > https://issues.apache.org/jira/browse/ZOOKEEPER-3243
> > > >
> > > > On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <nk...@cloudera.com>
> > > > wrote:
> > > >
> > > > > Hi Huizhi,
> > > > >
> > > > > You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.
> > > > >
> > > > > Regards,
> > > > > Norbert
> > > > >
> > > > > On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:
> > > > >
> > > > >> Hey ZK Experts,
> > > > >>
> > > > >> I am actively looking into the request throttling/quota feature. I
> > > > >> recalled that at the zookeeper meetup, Facebook presented a rate
> > quota
> > > > >> per client (see attached pic) feature. But I can't find it in any zk
> > > > >> doc or code. Is the feature available? If not, is there any reason?
> > > > >>
> > > > >>
> > > > >> Thanks!
> > > > >> -Huizhi
> > > > >>
> > > > >
> > >
> >

Re: Rate Quota

Posted by Li Wang <li...@gmail.com>.

Hi Huizhi,

I am also looking for this rate quota per client feature. Would you mind
sending again the picture from the Facebook presentation, as I didn't see
that attachment.

Thanks,

Li

On Wed, Jan 20, 2021 at 2:41 AM Norbert Kalmar <nk...@cloudera.com.invalid>
wrote:

> Sorry, I missed the point there.
> Unfortunately I don't know the timeline for this feature. Our friends at
> Facebook weren't active lately, but hope you'll get an answer (I see you
> also asked on the jira).
>
> - Norbert
>
> On Tue, Jan 19, 2021 at 8:33 PM Huizhi Lu <ih...@gmail.com> wrote:
>
> > Hi Norbert,
> >
> > Thanks for the reply. I understand request throttling was added in the
> > ticket ZOOKEEPER-3243. My understanding is that it's a global request
> > throttling: total requests for all clients. But it is not a per client
> > level throttling.
> >
> > Just realized that the facebook presentation listed the zk ticket:
> > https://issues.apache.org/jira/browse/ZOOKEEPER-3467. I think this is
> > what I'm looking for: reads/s and writes/s for per client. The feature
> > is not yet available. I wonder if there is a timeline for it. Thanks!
> >
> >
> > -Huizhi
> >
> > On Tue, Jan 19, 2021 at 2:20 AM Norbert Kalmar
> > <nk...@cloudera.com.invalid> wrote:
> > >
> > > https://issues.apache.org/jira/browse/ZOOKEEPER-3243
> > >
> > > On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <nk...@cloudera.com>
> > > wrote:
> > >
> > > > Hi Huizhi,
> > > >
> > > > You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.
> > > >
> > > > Regards,
> > > > Norbert
> > > >
> > > > On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:
> > > >
> > > >> Hey ZK Experts,
> > > >>
> > > >> I am actively looking into the request throttling/quota feature. I
> > > >> recalled that at the zookeeper meetup, Facebook presented a rate
> quota
> > > >> per client (see attached pic) feature. But I can't find it in any zk
> > > >> doc or code. Is the feature available? If not, is there any reason?
> > > >>
> > > >>
> > > >> Thanks!
> > > >> -Huizhi
> > > >>
> > > >
> >
>

Re: Rate Quota

Posted by Norbert Kalmar <nk...@cloudera.com.INVALID>.

Sorry, I missed the point there.
Unfortunately I don't know the timeline for this feature. Our friends at
Facebook weren't active lately, but hope you'll get an answer (I see you
also asked on the jira).

- Norbert

On Tue, Jan 19, 2021 at 8:33 PM Huizhi Lu <ih...@gmail.com> wrote:

> Hi Norbert,
>
> Thanks for the reply. I understand request throttling was added in the
> ticket ZOOKEEPER-3243. My understanding is that it's a global request
> throttling: total requests for all clients. But it is not a per client
> level throttling.
>
> Just realized that the facebook presentation listed the zk ticket:
> https://issues.apache.org/jira/browse/ZOOKEEPER-3467. I think this is
> what I'm looking for: reads/s and writes/s for per client. The feature
> is not yet available. I wonder if there is a timeline for it. Thanks!
>
>
> -Huizhi
>
> On Tue, Jan 19, 2021 at 2:20 AM Norbert Kalmar
> <nk...@cloudera.com.invalid> wrote:
> >
> > https://issues.apache.org/jira/browse/ZOOKEEPER-3243
> >
> > On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <nk...@cloudera.com>
> > wrote:
> >
> > > Hi Huizhi,
> > >
> > > You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.
> > >
> > > Regards,
> > > Norbert
> > >
> > > On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:
> > >
> > >> Hey ZK Experts,
> > >>
> > >> I am actively looking into the request throttling/quota feature. I
> > >> recalled that at the zookeeper meetup, Facebook presented a rate quota
> > >> per client (see attached pic) feature. But I can't find it in any zk
> > >> doc or code. Is the feature available? If not, is there any reason?
> > >>
> > >>
> > >> Thanks!
> > >> -Huizhi
> > >>
> > >
>

Re: Rate Quota

Posted by Huizhi Lu <ih...@gmail.com>.

Hi Norbert,

Thanks for the reply. I understand request throttling was added in the
ticket ZOOKEEPER-3243. My understanding is that it's a global request
throttling: total requests for all clients. But it is not a per client
level throttling.

Just realized that the facebook presentation listed the zk ticket:
https://issues.apache.org/jira/browse/ZOOKEEPER-3467. I think this is
what I'm looking for: reads/s and writes/s for per client. The feature
is not yet available. I wonder if there is a timeline for it. Thanks!

-Huizhi

On Tue, Jan 19, 2021 at 2:20 AM Norbert Kalmar
<nk...@cloudera.com.invalid> wrote:
>
> https://issues.apache.org/jira/browse/ZOOKEEPER-3243
>
> On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <nk...@cloudera.com>
> wrote:
>
> > Hi Huizhi,
> >
> > You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.
> >
> > Regards,
> > Norbert
> >
> > On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:
> >
> >> Hey ZK Experts,
> >>
> >> I am actively looking into the request throttling/quota feature. I
> >> recalled that at the zookeeper meetup, Facebook presented a rate quota
> >> per client (see attached pic) feature. But I can't find it in any zk
> >> doc or code. Is the feature available? If not, is there any reason?
> >>
> >>
> >> Thanks!
> >> -Huizhi
> >>
> >

Re: Rate Quota

Posted by Norbert Kalmar <nk...@cloudera.com.INVALID>.

https://issues.apache.org/jira/browse/ZOOKEEPER-3243

On Tue, Jan 19, 2021 at 11:19 AM Norbert Kalmar <nk...@cloudera.com>
wrote:

> Hi Huizhi,
>
> You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.
>
> Regards,
> Norbert
>
> On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:
>
>> Hey ZK Experts,
>>
>> I am actively looking into the request throttling/quota feature. I
>> recalled that at the zookeeper meetup, Facebook presented a rate quota
>> per client (see attached pic) feature. But I can't find it in any zk
>> doc or code. Is the feature available? If not, is there any reason?
>>
>>
>> Thanks!
>> -Huizhi
>>
>

Re: Rate Quota

Posted by Norbert Kalmar <nk...@cloudera.com.INVALID>.

Hi Huizhi,

You might be looking for ZOOKEEPER-3243, it is available from 3.6.0.

Regards,
Norbert

On Tue, Jan 19, 2021 at 9:49 AM Huizhi Lu <hz...@apache.org> wrote:

> Hey ZK Experts,
>
> I am actively looking into the request throttling/quota feature. I
> recalled that at the zookeeper meetup, Facebook presented a rate quota
> per client (see attached pic) feature. But I can't find it in any zk
> doc or code. Is the feature available? If not, is there any reason?
>
>
> Thanks!
> -Huizhi
>