You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Bhavesh Mistry <mi...@gmail.com> on 2014/11/14 19:34:37 UTC
Enforcing Network Bandwidth Quote with New Java Producer
HI Kafka Team,
We like to enforce a network bandwidth quota limit per minute on producer
side. How can I do this ? I need some way to count compressed bytes on
producer ? I know there is callback does not give this ability ? Let me
know the best way.
Thanks,
Bhavesh
Re: Enforcing Network Bandwidth Quote with New Java Producer
Posted by Jun Rao <ju...@gmail.com>.
Either is fine. "outgoing-byte-rate" gives you the total and "byte-rate"
gives you per topic.
Thanks,
Jun
On Mon, Nov 17, 2014 at 3:58 PM, Bhavesh Mistry <mi...@gmail.com>
wrote:
> Hi Jun,
>
> So If I set the "*metrics.sample.window.ms
> <http://metrics.sample.window.ms>*" to 1 minute, I will be able to get
> compression bytes count per minute. Which one should I be using from
> following ?
>
> "outgoing-byte-rate", //The average number of outgoing
> bytes sent
> per second to all servers.
> "byte-rate", //Rate Per seconds
>
>
> Thanks,
>
> Bhavesh
>
> On Fri, Nov 14, 2014 at 3:39 PM, Jun Rao <ju...@gmail.com> wrote:
>
> > We have a metric that measures the per-topic bytes send rate (after
> > compression). You can get the values through the producer api.
> >
> > Thanks,
> >
> > Jun
> >
> > On Fri, Nov 14, 2014 at 10:34 AM, Bhavesh Mistry <
> > mistry.p.bhavesh@gmail.com
> > > wrote:
> >
> > > HI Kafka Team,
> > >
> > > We like to enforce a network bandwidth quota limit per minute on
> producer
> > > side. How can I do this ? I need some way to count compressed bytes
> on
> > > producer ? I know there is callback does not give this ability ? Let
> me
> > > know the best way.
> > >
> > >
> > >
> > > Thanks,
> > >
> > > Bhavesh
> > >
> >
>
Re: Enforcing Network Bandwidth Quote with New Java Producer
Posted by Bhavesh Mistry <mi...@gmail.com>.
Hi Jun,
So If I set the "*metrics.sample.window.ms
<http://metrics.sample.window.ms>*" to 1 minute, I will be able to get
compression bytes count per minute. Which one should I be using from
following ?
"outgoing-byte-rate", //The average number of outgoing bytes sent
per second to all servers.
"byte-rate", //Rate Per seconds
Thanks,
Bhavesh
On Fri, Nov 14, 2014 at 3:39 PM, Jun Rao <ju...@gmail.com> wrote:
> We have a metric that measures the per-topic bytes send rate (after
> compression). You can get the values through the producer api.
>
> Thanks,
>
> Jun
>
> On Fri, Nov 14, 2014 at 10:34 AM, Bhavesh Mistry <
> mistry.p.bhavesh@gmail.com
> > wrote:
>
> > HI Kafka Team,
> >
> > We like to enforce a network bandwidth quota limit per minute on producer
> > side. How can I do this ? I need some way to count compressed bytes on
> > producer ? I know there is callback does not give this ability ? Let me
> > know the best way.
> >
> >
> >
> > Thanks,
> >
> > Bhavesh
> >
>
Re: Enforcing Network Bandwidth Quote with New Java Producer
Posted by Jun Rao <ju...@gmail.com>.
We have a metric that measures the per-topic bytes send rate (after
compression). You can get the values through the producer api.
Thanks,
Jun
On Fri, Nov 14, 2014 at 10:34 AM, Bhavesh Mistry <mistry.p.bhavesh@gmail.com
> wrote:
> HI Kafka Team,
>
> We like to enforce a network bandwidth quota limit per minute on producer
> side. How can I do this ? I need some way to count compressed bytes on
> producer ? I know there is callback does not give this ability ? Let me
> know the best way.
>
>
>
> Thanks,
>
> Bhavesh
>
Re: Enforcing Network Bandwidth Quote with New Java Producer
Posted by Jun Rao <ju...@gmail.com>.
We have a metric that measures the per-topic bytes send rate (after
compression). You can get the values through the producer api.
Thanks,
Jun
On Fri, Nov 14, 2014 at 10:34 AM, Bhavesh Mistry <mistry.p.bhavesh@gmail.com
> wrote:
> HI Kafka Team,
>
> We like to enforce a network bandwidth quota limit per minute on producer
> side. How can I do this ? I need some way to count compressed bytes on
> producer ? I know there is callback does not give this ability ? Let me
> know the best way.
>
>
>
> Thanks,
>
> Bhavesh
>