You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Jun Rao <ju...@confluent.io> on 2017/05/05 22:11:26 UTC
[DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Hi, Everyone,
We created "KIP-153 : Include only client traffic in BytesOutPerSec metric".
https://cwiki.apache.org/confluence/display/KAFKA/KIP-153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
Please take a look and provide your feedback.
Thanks,
Jun
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec
metric
Posted by Edoardo Comar <EC...@uk.ibm.com>.
Thanks for the KIP, Jun
We're constantly reminded of this inconsistency when we look at the
traffic on the dashboards !
--------------------------------------------------
Edoardo Comar
IBM MessageHub
ecomar@uk.ibm.com
IBM UK Ltd, Hursley Park, SO21 2JN
IBM United Kingdom Limited Registered in England and Wales with number
741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6
3AU
From: Jun Rao <ju...@confluent.io>
To: "dev@kafka.apache.org" <de...@kafka.apache.org>
Date: 05/05/2017 18:11
Subject: [DISCUSS] KIP-153 : Include only client traffic in
BytesOutPerSec metric
Hi, Everyone,
We created "KIP-153 : Include only client traffic in BytesOutPerSec
metric".
https://cwiki.apache.org/confluence/display/KAFKA/KIP-153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
Please take a look and provide your feedback.
Thanks,
Jun
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number
741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Jun Rao <ju...@confluent.io>.
Hi, Xavier,
I think the per topic metric is more useful for measuring the traffic from
the clients. For internal replication, perhaps the aggregate value is
enough.
Thanks,
Jun
On Fri, May 5, 2017 at 6:11 PM, Xavier Léauté <xa...@confluent.io> wrote:
> Any reason we are not keeping the per-topic breakdown for inter-broker
> traffic?
>
>
> On Fri, May 5, 2017 at 4:52 PM Onur Karaman <on...@gmail.com>
> wrote:
>
> > Looks good. Thanks!
> >
> > On Fri, May 5, 2017 at 4:44 PM, Roger Hoover <ro...@gmail.com>
> > wrote:
> >
> > > Very helpful. Thank you, Jun.
> > >
> > > On Fri, May 5, 2017 at 4:42 PM, Guozhang Wang <wa...@gmail.com>
> > wrote:
> > >
> > > > Jun,
> > > >
> > > > Thanks for the KIP, LGTM.
> > > >
> > > > Guozhang
> > > >
> > > > On Fri, May 5, 2017 at 3:38 PM, Ismael Juma <is...@juma.me.uk>
> wrote:
> > > >
> > > > > Thanks Jun, looks good to me.
> > > > >
> > > > > Ismael
> > > > >
> > > > > On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
> > > > >
> > > > > > Hi, Ismael,
> > > > > >
> > > > > > Good point. Updated the KIP with ReplicationBytesInPerSec.
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Jun
> > > > > >
> > > > > > On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk>
> > > wrote:
> > > > > >
> > > > > > > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I
> > > > > understand
> > > > > > > correctly that we are introducing ReplicationBytesOutPerSec,
> but
> > > not
> > > > > > > ReplicationBytesInPerSec?
> > > > > > > If so, what's the reason?
> > > > > > >
> > > > > > > Ismael
> > > > > > >
> > > > > > > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io>
> > wrote:
> > > > > > >
> > > > > > > > Hi, Everyone,
> > > > > > > >
> > > > > > > > We created "KIP-153 : Include only client traffic in
> > > BytesOutPerSec
> > > > > > > > metric".
> > > > > > > >
> > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > > > > > > >
> > > > > > > > Please take a look and provide your feedback.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > >
> > > > > > > > Jun
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > -- Guozhang
> > > >
> > >
> >
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Xavier Léauté <xa...@confluent.io>.
Any reason we are not keeping the per-topic breakdown for inter-broker
traffic?
On Fri, May 5, 2017 at 4:52 PM Onur Karaman <on...@gmail.com>
wrote:
> Looks good. Thanks!
>
> On Fri, May 5, 2017 at 4:44 PM, Roger Hoover <ro...@gmail.com>
> wrote:
>
> > Very helpful. Thank you, Jun.
> >
> > On Fri, May 5, 2017 at 4:42 PM, Guozhang Wang <wa...@gmail.com>
> wrote:
> >
> > > Jun,
> > >
> > > Thanks for the KIP, LGTM.
> > >
> > > Guozhang
> > >
> > > On Fri, May 5, 2017 at 3:38 PM, Ismael Juma <is...@juma.me.uk> wrote:
> > >
> > > > Thanks Jun, looks good to me.
> > > >
> > > > Ismael
> > > >
> > > > On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
> > > >
> > > > > Hi, Ismael,
> > > > >
> > > > > Good point. Updated the KIP with ReplicationBytesInPerSec.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jun
> > > > >
> > > > > On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk>
> > wrote:
> > > > >
> > > > > > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I
> > > > understand
> > > > > > correctly that we are introducing ReplicationBytesOutPerSec, but
> > not
> > > > > > ReplicationBytesInPerSec?
> > > > > > If so, what's the reason?
> > > > > >
> > > > > > Ismael
> > > > > >
> > > > > > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io>
> wrote:
> > > > > >
> > > > > > > Hi, Everyone,
> > > > > > >
> > > > > > > We created "KIP-153 : Include only client traffic in
> > BytesOutPerSec
> > > > > > > metric".
> > > > > > >
> > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > > > > > >
> > > > > > > Please take a look and provide your feedback.
> > > > > > >
> > > > > > > Thanks,
> > > > > > >
> > > > > > > Jun
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > -- Guozhang
> > >
> >
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Onur Karaman <on...@gmail.com>.
Looks good. Thanks!
On Fri, May 5, 2017 at 4:44 PM, Roger Hoover <ro...@gmail.com> wrote:
> Very helpful. Thank you, Jun.
>
> On Fri, May 5, 2017 at 4:42 PM, Guozhang Wang <wa...@gmail.com> wrote:
>
> > Jun,
> >
> > Thanks for the KIP, LGTM.
> >
> > Guozhang
> >
> > On Fri, May 5, 2017 at 3:38 PM, Ismael Juma <is...@juma.me.uk> wrote:
> >
> > > Thanks Jun, looks good to me.
> > >
> > > Ismael
> > >
> > > On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > > Hi, Ismael,
> > > >
> > > > Good point. Updated the KIP with ReplicationBytesInPerSec.
> > > >
> > > > Thanks,
> > > >
> > > > Jun
> > > >
> > > > On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk>
> wrote:
> > > >
> > > > > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I
> > > understand
> > > > > correctly that we are introducing ReplicationBytesOutPerSec, but
> not
> > > > > ReplicationBytesInPerSec?
> > > > > If so, what's the reason?
> > > > >
> > > > > Ismael
> > > > >
> > > > > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
> > > > >
> > > > > > Hi, Everyone,
> > > > > >
> > > > > > We created "KIP-153 : Include only client traffic in
> BytesOutPerSec
> > > > > > metric".
> > > > > >
> > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > > > > >
> > > > > > Please take a look and provide your feedback.
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Jun
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > -- Guozhang
> >
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Roger Hoover <ro...@gmail.com>.
Very helpful. Thank you, Jun.
On Fri, May 5, 2017 at 4:42 PM, Guozhang Wang <wa...@gmail.com> wrote:
> Jun,
>
> Thanks for the KIP, LGTM.
>
> Guozhang
>
> On Fri, May 5, 2017 at 3:38 PM, Ismael Juma <is...@juma.me.uk> wrote:
>
> > Thanks Jun, looks good to me.
> >
> > Ismael
> >
> > On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
> >
> > > Hi, Ismael,
> > >
> > > Good point. Updated the KIP with ReplicationBytesInPerSec.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > > On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk> wrote:
> > >
> > > > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I
> > understand
> > > > correctly that we are introducing ReplicationBytesOutPerSec, but not
> > > > ReplicationBytesInPerSec?
> > > > If so, what's the reason?
> > > >
> > > > Ismael
> > > >
> > > > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
> > > >
> > > > > Hi, Everyone,
> > > > >
> > > > > We created "KIP-153 : Include only client traffic in BytesOutPerSec
> > > > > metric".
> > > > >
> > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > > > >
> > > > > Please take a look and provide your feedback.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jun
> > > > >
> > > >
> > >
> >
>
>
>
> --
> -- Guozhang
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Guozhang Wang <wa...@gmail.com>.
Jun,
Thanks for the KIP, LGTM.
Guozhang
On Fri, May 5, 2017 at 3:38 PM, Ismael Juma <is...@juma.me.uk> wrote:
> Thanks Jun, looks good to me.
>
> Ismael
>
> On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, Ismael,
> >
> > Good point. Updated the KIP with ReplicationBytesInPerSec.
> >
> > Thanks,
> >
> > Jun
> >
> > On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk> wrote:
> >
> > > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I
> understand
> > > correctly that we are introducing ReplicationBytesOutPerSec, but not
> > > ReplicationBytesInPerSec?
> > > If so, what's the reason?
> > >
> > > Ismael
> > >
> > > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
> > >
> > > > Hi, Everyone,
> > > >
> > > > We created "KIP-153 : Include only client traffic in BytesOutPerSec
> > > > metric".
> > > >
> > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > > >
> > > > Please take a look and provide your feedback.
> > > >
> > > > Thanks,
> > > >
> > > > Jun
> > > >
> > >
> >
>
--
-- Guozhang
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Ismael Juma <is...@juma.me.uk>.
Thanks Jun, looks good to me.
Ismael
On Fri, May 5, 2017 at 11:35 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, Ismael,
>
> Good point. Updated the KIP with ReplicationBytesInPerSec.
>
> Thanks,
>
> Jun
>
> On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk> wrote:
>
> > Thanks for the KIP, Jun. Good to fix this inconsistency. Do I understand
> > correctly that we are introducing ReplicationBytesOutPerSec, but not
> > ReplicationBytesInPerSec?
> > If so, what's the reason?
> >
> > Ismael
> >
> > On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
> >
> > > Hi, Everyone,
> > >
> > > We created "KIP-153 : Include only client traffic in BytesOutPerSec
> > > metric".
> > >
> > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> > >
> > > Please take a look and provide your feedback.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> >
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Jun Rao <ju...@confluent.io>.
Hi, Ismael,
Good point. Updated the KIP with ReplicationBytesInPerSec.
Thanks,
Jun
On Fri, May 5, 2017 at 3:16 PM, Ismael Juma <is...@juma.me.uk> wrote:
> Thanks for the KIP, Jun. Good to fix this inconsistency. Do I understand
> correctly that we are introducing ReplicationBytesOutPerSec, but not
> ReplicationBytesInPerSec?
> If so, what's the reason?
>
> Ismael
>
> On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
>
> > Hi, Everyone,
> >
> > We created "KIP-153 : Include only client traffic in BytesOutPerSec
> > metric".
> >
> > https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> > 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
> >
> > Please take a look and provide your feedback.
> >
> > Thanks,
> >
> > Jun
> >
>
Re: [DISCUSS] KIP-153 : Include only client traffic in BytesOutPerSec metric
Posted by Ismael Juma <is...@juma.me.uk>.
Thanks for the KIP, Jun. Good to fix this inconsistency. Do I understand
correctly that we are introducing ReplicationBytesOutPerSec, but not
ReplicationBytesInPerSec?
If so, what's the reason?
Ismael
On Fri, May 5, 2017 at 11:11 PM, Jun Rao <ju...@confluent.io> wrote:
> Hi, Everyone,
>
> We created "KIP-153 : Include only client traffic in BytesOutPerSec
> metric".
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> 153+%3A+Include+only+client+traffic+in+BytesOutPerSec+metric
>
> Please take a look and provide your feedback.
>
> Thanks,
>
> Jun
>