measuring incoming bytes

[Amitav Mohanty <am...@gmail.com>]

Hi

I am trying to measure incoming bytes over time. I am trying collect the
following metric and apply integral function over a set of data points on a
time series.

kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
FifteenMinuteRate

It seems that the number I am getting is much less than expected. So, I am
suspecting that my understanding of this metric is wrong.

I initially thought this metric is the total volume of bytes that came in
for that topic in last 15 mins. So, if I collect this metric every 15 mins,
then I will have total volume over time by calculating the sum of data
points in the time interval.

Please confirm if my understanding is correct.

Regards,
Amitav

Re: measuring incoming bytes

[Christopher Bogan <am...@gmail.com>]

Bytespersec online

On Wed, Feb 6, 2019, 12:22 PM Amitav Mohanty <amitavmohanty01@gmail.com
wrote:

> Which part?
>
> -Amitav
>
> On Mon, Feb 4, 2019 at 8:42 PM Christopher Bogan <
> ambitiousking712@gmail.com>
> wrote:
>
> > Correct
> >
> > On Sat, Feb 2, 2019, 10:09 AM Amitav Mohanty <amitavmohanty01@gmail.com
> > wrote:
> >
> > > Hi
> > >
> > > I am trying to measure incoming bytes over time. I am trying collect
> the
> > > following metric and apply integral function over a set of data points
> > on a
> > > time series.
> > >
> > > kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
> > > FifteenMinuteRate
> > >
> > > It seems that the number I am getting is much less than expected. So, I
> > am
> > > suspecting that my understanding of this metric is wrong.
> > >
> > > I initially thought this metric is the total volume of bytes that came
> in
> > > for that topic in last 15 mins. So, if I collect this metric every 15
> > mins,
> > > then I will have total volume over time by calculating the sum of data
> > > points in the time interval.
> > >
> > > Please confirm if my understanding is correct.
> > >
> > > Regards,
> > > Amitav
> > >
> >
>

Re: measuring incoming bytes

[Amitav Mohanty <am...@gmail.com>]

Which part?

-Amitav

On Mon, Feb 4, 2019 at 8:42 PM Christopher Bogan <am...@gmail.com>
wrote:

> Correct
>
> On Sat, Feb 2, 2019, 10:09 AM Amitav Mohanty <amitavmohanty01@gmail.com
> wrote:
>
> > Hi
> >
> > I am trying to measure incoming bytes over time. I am trying collect the
> > following metric and apply integral function over a set of data points
> on a
> > time series.
> >
> > kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
> > FifteenMinuteRate
> >
> > It seems that the number I am getting is much less than expected. So, I
> am
> > suspecting that my understanding of this metric is wrong.
> >
> > I initially thought this metric is the total volume of bytes that came in
> > for that topic in last 15 mins. So, if I collect this metric every 15
> mins,
> > then I will have total volume over time by calculating the sum of data
> > points in the time interval.
> >
> > Please confirm if my understanding is correct.
> >
> > Regards,
> > Amitav
> >
>

Re: measuring incoming bytes

[Christopher Bogan <am...@gmail.com>]

Correct

On Sat, Feb 2, 2019, 10:09 AM Amitav Mohanty <amitavmohanty01@gmail.com
wrote:

> Hi
>
> I am trying to measure incoming bytes over time. I am trying collect the
> following metric and apply integral function over a set of data points on a
> time series.
>
> kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
> FifteenMinuteRate
>
> It seems that the number I am getting is much less than expected. So, I am
> suspecting that my understanding of this metric is wrong.
>
> I initially thought this metric is the total volume of bytes that came in
> for that topic in last 15 mins. So, if I collect this metric every 15 mins,
> then I will have total volume over time by calculating the sum of data
> points in the time interval.
>
> Please confirm if my understanding is correct.
>
> Regards,
> Amitav
>

Re: measuring incoming bytes

[Amitav Mohanty <am...@gmail.com>]

Thanks for the explanation. Can you help me understand what this metric
signify then?

Also, count would be the number of messages is what I thought.

-Amitav

On Sat, Feb 2, 2019 at 11:45 PM Kamal Chandraprakash <
kamal.chandraprakash@gmail.com> wrote:

> In Yammer metrics, the 15MinuteRate provided by the Meter is not a pure
> average for the last 15 minutes. It's a Exponential Weighted Moving
> Average.
> The value is calculated by taking 36% of weighted average from the broker
> start time and 64 % of weighted average from the last 15 minutes.
>
> I initially thought this metric is the total volume of bytes that came in
> for that topic in last 15 mins. So, if I collect this metric every 15 mins,
> then I will have total volume over time by calculating the sum of data
> points in the time interval.
>
> You can use `count` instead of `15MinuteRate` to find out the total volume
> of bytes that came in a topic for last 15 mins by taking diff of the two
> points.
>
>
>
> On Sat, Feb 2, 2019 at 8:39 PM Amitav Mohanty <am...@gmail.com>
> wrote:
>
> > Hi
> >
> > I am trying to measure incoming bytes over time. I am trying collect the
> > following metric and apply integral function over a set of data points
> on a
> > time series.
> >
> > kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
> > FifteenMinuteRate
> >
> > It seems that the number I am getting is much less than expected. So, I
> am
> > suspecting that my understanding of this metric is wrong.
> >
> > I initially thought this metric is the total volume of bytes that came in
> > for that topic in last 15 mins. So, if I collect this metric every 15
> mins,
> > then I will have total volume over time by calculating the sum of data
> > points in the time interval.
> >
> > Please confirm if my understanding is correct.
> >
> > Regards,
> > Amitav
> >
>

Re: measuring incoming bytes

[Kamal Chandraprakash <ka...@gmail.com>]

In Yammer metrics, the 15MinuteRate provided by the Meter is not a pure
average for the last 15 minutes. It's a Exponential Weighted Moving
Average.
The value is calculated by taking 36% of weighted average from the broker
start time and 64 % of weighted average from the last 15 minutes.

I initially thought this metric is the total volume of bytes that came in
for that topic in last 15 mins. So, if I collect this metric every 15 mins,
then I will have total volume over time by calculating the sum of data
points in the time interval.

You can use `count` instead of `15MinuteRate` to find out the total volume
of bytes that came in a topic for last 15 mins by taking diff of the two
points.



On Sat, Feb 2, 2019 at 8:39 PM Amitav Mohanty <am...@gmail.com>
wrote:

> Hi
>
> I am trying to measure incoming bytes over time. I am trying collect the
> following metric and apply integral function over a set of data points on a
> time series.
>
> kafka.server:type=BrokerTopicMetrics,name=BytesInPerSec,topic=my_topic
> FifteenMinuteRate
>
> It seems that the number I am getting is much less than expected. So, I am
> suspecting that my understanding of this metric is wrong.
>
> I initially thought this metric is the total volume of bytes that came in
> for that topic in last 15 mins. So, if I collect this metric every 15 mins,
> then I will have total volume over time by calculating the sum of data
> points in the time interval.
>
> Please confirm if my understanding is correct.
>
> Regards,
> Amitav
>