You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by Paul Power <pa...@openjawtech.com> on 2017/05/05 13:16:53 UTC
Mismatch between numbers in Aggregate Report and InfluxDB via backend listener
Hi:
In JMeter 3.2 I am running a simple HTTP POST json test on my own PC
against processes also running on my PC. In total 150 requests are sent.
I am still developing the test so I have both an Aggregate Report and
Backend listener.
My problem is that the numbers do not match e.g.
Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
The max is 1850ms in both, but the min is 147 in Aggregate Report and 1122
in InfluxDB.
Is this a problem or do the number have different meanings?
UIltimately I want to disable/remove the Aggregate Report.
All help gratefully received
,
Paul
--
*The information in this e-mail and any attachments is confidential. It is
intended solely for the addressee(s) named above. If you are not an
intended recipient, please notify the sender and delete the message and any
attachments from your system. Any use, copying or disclosure of the
contents is unauthorised unless expressly permitted. Any views expressed in
this message are those of the sender unless expressly stated to be those of
OpenJaw. Virus checking of emails and attachments is the responsibility of
the recipient and OpenJaw cannot accept responsibility for any loss or
damage arising from the use of this email or attachments. OpenJaw
Technologies Limited is a limited company registered in Ireland having
registration number 353613 and registered office at Grattan Bridge House, 1
Ormond Quay Upper, Dublin 7.*
Re: Mismatch between numbers in Aggregate Report and InfluxDB via
backend listener
Posted by Philippe Mouawad <ph...@gmail.com>.
Hello,
Can you compare with Report Dashboard summary results:
- http://jmeter.apache.org/usermanual/generating-dashboard.html
Regarding values in InfluxDB, how are you computing them ?
Thanks
On Mon, May 8, 2017 at 1:09 PM, Paul Power <pa...@openjawtech.com>
wrote:
> 90%: 1593.9 in InfluxDb, 1735 in Aggregate Report
> 95%: 1631.9 in InfluxDb, 2542 in Aggregate Report
> 99%: 1646.93 in InfluxDB, 3256 in Aggregate Report
>
> Max is 3622 for this run
>
> Regards,
> Paul
>
> On 8 May 2017 at 10:47, Maxime Chassagneux <ma...@gmail.com>
> wrote:
>
> > Hi,
> >
> > Perfect for mean, max and min metrics ! Now for percentile, timeboxed
> don't
> > makes sense, so we use a large sliding window ( 50 000 as you set ).
> > I have to check in report what method is use to percentile.
> >
> > The difference is important in your result ?
> >
> > 2017-05-08 9:03 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> >
> > > Many thanks Maxime:
> > >
> > > I made these changes:
> > >
> > > backend_metrics_window_mode=timed
> > > backend_metrics_large_window=50000
> > >
> > > The average, max and min are now correct. The 90%, 95% and 99% values
> > are
> > > still wrong.
> > >
> > > Regards,
> > > Paul
> > >
> > >
> > >
> > >
> > > On 5 May 2017 at 16:26, Maxime Chassagneux <
> maxime.chassagneux@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > Try to change the window mode of the backend metric to time boxed (
> > i.e
> > > in
> > > > jmeter.properties and see "BackendListener - configuration" section
> ).
> > > > So each 5 seconds, all metrics are send to influxdb and reset. ( no
> > > > aggregation in a slidding window array )
> > > >
> > > > --
> > > > Maxime
> > > >
> > > >
> > > >
> > > > 2017-05-05 15:16 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> > > >
> > > > > Hi:
> > > > >
> > > > > In JMeter 3.2 I am running a simple HTTP POST json test on my own
> PC
> > > > > against processes also running on my PC. In total 150 requests are
> > > sent.
> > > > >
> > > > > I am still developing the test so I have both an Aggregate Report
> and
> > > > > Backend listener.
> > > > >
> > > > > My problem is that the numbers do not match e.g.
> > > > >
> > > > > Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
> > > > > The max is 1850ms in both, but the min is 147 in Aggregate Report
> and
> > > > 1122
> > > > > in InfluxDB.
> > > > >
> > > > > Is this a problem or do the number have different meanings?
> > > > >
> > > > > UIltimately I want to disable/remove the Aggregate Report.
> > > > >
> > > > > All help gratefully received
> > > > > ,
> > > > > Paul
> > > > >
> > > > > --
> > > > > *The information in this e-mail and any attachments is
> confidential.
> > It
> > > > is
> > > > > intended solely for the addressee(s) named above. If you are not an
> > > > > intended recipient, please notify the sender and delete the message
> > and
> > > > any
> > > > > attachments from your system. Any use, copying or disclosure of the
> > > > > contents is unauthorised unless expressly permitted. Any views
> > > expressed
> > > > in
> > > > > this message are those of the sender unless expressly stated to be
> > > those
> > > > of
> > > > > OpenJaw. Virus checking of emails and attachments is the
> > responsibility
> > > > of
> > > > > the recipient and OpenJaw cannot accept responsibility for any loss
> > or
> > > > > damage arising from the use of this email or attachments. OpenJaw
> > > > > Technologies Limited is a limited company registered in Ireland
> > having
> > > > > registration number 353613 and registered office at Grattan Bridge
> > > > House, 1
> > > > > Ormond Quay Upper, Dublin 7.*
> > > > >
> > > >
> > >
> > > --
> > > *The information in this e-mail and any attachments is confidential. It
> > is
> > > intended solely for the addressee(s) named above. If you are not an
> > > intended recipient, please notify the sender and delete the message and
> > any
> > > attachments from your system. Any use, copying or disclosure of the
> > > contents is unauthorised unless expressly permitted. Any views
> expressed
> > in
> > > this message are those of the sender unless expressly stated to be
> those
> > of
> > > OpenJaw. Virus checking of emails and attachments is the responsibility
> > of
> > > the recipient and OpenJaw cannot accept responsibility for any loss or
> > > damage arising from the use of this email or attachments. OpenJaw
> > > Technologies Limited is a limited company registered in Ireland having
> > > registration number 353613 and registered office at Grattan Bridge
> > House, 1
> > > Ormond Quay Upper, Dublin 7.*
> > >
> >
>
> --
> *The information in this e-mail and any attachments is confidential. It is
> intended solely for the addressee(s) named above. If you are not an
> intended recipient, please notify the sender and delete the message and any
> attachments from your system. Any use, copying or disclosure of the
> contents is unauthorised unless expressly permitted. Any views expressed in
> this message are those of the sender unless expressly stated to be those of
> OpenJaw. Virus checking of emails and attachments is the responsibility of
> the recipient and OpenJaw cannot accept responsibility for any loss or
> damage arising from the use of this email or attachments. OpenJaw
> Technologies Limited is a limited company registered in Ireland having
> registration number 353613 and registered office at Grattan Bridge House, 1
> Ormond Quay Upper, Dublin 7.*
>
--
Cordialement.
Philippe Mouawad.
Re: Mismatch between numbers in Aggregate Report and InfluxDB via
backend listener
Posted by Paul Power <pa...@openjawtech.com>.
90%: 1593.9 in InfluxDb, 1735 in Aggregate Report
95%: 1631.9 in InfluxDb, 2542 in Aggregate Report
99%: 1646.93 in InfluxDB, 3256 in Aggregate Report
Max is 3622 for this run
Regards,
Paul
On 8 May 2017 at 10:47, Maxime Chassagneux <ma...@gmail.com>
wrote:
> Hi,
>
> Perfect for mean, max and min metrics ! Now for percentile, timeboxed don't
> makes sense, so we use a large sliding window ( 50 000 as you set ).
> I have to check in report what method is use to percentile.
>
> The difference is important in your result ?
>
> 2017-05-08 9:03 GMT+02:00 Paul Power <pa...@openjawtech.com>:
>
> > Many thanks Maxime:
> >
> > I made these changes:
> >
> > backend_metrics_window_mode=timed
> > backend_metrics_large_window=50000
> >
> > The average, max and min are now correct. The 90%, 95% and 99% values
> are
> > still wrong.
> >
> > Regards,
> > Paul
> >
> >
> >
> >
> > On 5 May 2017 at 16:26, Maxime Chassagneux <maxime.chassagneux@gmail.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > > Try to change the window mode of the backend metric to time boxed (
> i.e
> > in
> > > jmeter.properties and see "BackendListener - configuration" section ).
> > > So each 5 seconds, all metrics are send to influxdb and reset. ( no
> > > aggregation in a slidding window array )
> > >
> > > --
> > > Maxime
> > >
> > >
> > >
> > > 2017-05-05 15:16 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> > >
> > > > Hi:
> > > >
> > > > In JMeter 3.2 I am running a simple HTTP POST json test on my own PC
> > > > against processes also running on my PC. In total 150 requests are
> > sent.
> > > >
> > > > I am still developing the test so I have both an Aggregate Report and
> > > > Backend listener.
> > > >
> > > > My problem is that the numbers do not match e.g.
> > > >
> > > > Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
> > > > The max is 1850ms in both, but the min is 147 in Aggregate Report and
> > > 1122
> > > > in InfluxDB.
> > > >
> > > > Is this a problem or do the number have different meanings?
> > > >
> > > > UIltimately I want to disable/remove the Aggregate Report.
> > > >
> > > > All help gratefully received
> > > > ,
> > > > Paul
> > > >
> > > > --
> > > > *The information in this e-mail and any attachments is confidential.
> It
> > > is
> > > > intended solely for the addressee(s) named above. If you are not an
> > > > intended recipient, please notify the sender and delete the message
> and
> > > any
> > > > attachments from your system. Any use, copying or disclosure of the
> > > > contents is unauthorised unless expressly permitted. Any views
> > expressed
> > > in
> > > > this message are those of the sender unless expressly stated to be
> > those
> > > of
> > > > OpenJaw. Virus checking of emails and attachments is the
> responsibility
> > > of
> > > > the recipient and OpenJaw cannot accept responsibility for any loss
> or
> > > > damage arising from the use of this email or attachments. OpenJaw
> > > > Technologies Limited is a limited company registered in Ireland
> having
> > > > registration number 353613 and registered office at Grattan Bridge
> > > House, 1
> > > > Ormond Quay Upper, Dublin 7.*
> > > >
> > >
> >
> > --
> > *The information in this e-mail and any attachments is confidential. It
> is
> > intended solely for the addressee(s) named above. If you are not an
> > intended recipient, please notify the sender and delete the message and
> any
> > attachments from your system. Any use, copying or disclosure of the
> > contents is unauthorised unless expressly permitted. Any views expressed
> in
> > this message are those of the sender unless expressly stated to be those
> of
> > OpenJaw. Virus checking of emails and attachments is the responsibility
> of
> > the recipient and OpenJaw cannot accept responsibility for any loss or
> > damage arising from the use of this email or attachments. OpenJaw
> > Technologies Limited is a limited company registered in Ireland having
> > registration number 353613 and registered office at Grattan Bridge
> House, 1
> > Ormond Quay Upper, Dublin 7.*
> >
>
--
*The information in this e-mail and any attachments is confidential. It is
intended solely for the addressee(s) named above. If you are not an
intended recipient, please notify the sender and delete the message and any
attachments from your system. Any use, copying or disclosure of the
contents is unauthorised unless expressly permitted. Any views expressed in
this message are those of the sender unless expressly stated to be those of
OpenJaw. Virus checking of emails and attachments is the responsibility of
the recipient and OpenJaw cannot accept responsibility for any loss or
damage arising from the use of this email or attachments. OpenJaw
Technologies Limited is a limited company registered in Ireland having
registration number 353613 and registered office at Grattan Bridge House, 1
Ormond Quay Upper, Dublin 7.*
Re: Mismatch between numbers in Aggregate Report and InfluxDB via
backend listener
Posted by Maxime Chassagneux <ma...@gmail.com>.
Hi,
Perfect for mean, max and min metrics ! Now for percentile, timeboxed don't
makes sense, so we use a large sliding window ( 50 000 as you set ).
I have to check in report what method is use to percentile.
The difference is important in your result ?
2017-05-08 9:03 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> Many thanks Maxime:
>
> I made these changes:
>
> backend_metrics_window_mode=timed
> backend_metrics_large_window=50000
>
> The average, max and min are now correct. The 90%, 95% and 99% values are
> still wrong.
>
> Regards,
> Paul
>
>
>
>
> On 5 May 2017 at 16:26, Maxime Chassagneux <ma...@gmail.com>
> wrote:
>
> > Hi,
> >
> > Try to change the window mode of the backend metric to time boxed ( i.e
> in
> > jmeter.properties and see "BackendListener - configuration" section ).
> > So each 5 seconds, all metrics are send to influxdb and reset. ( no
> > aggregation in a slidding window array )
> >
> > --
> > Maxime
> >
> >
> >
> > 2017-05-05 15:16 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> >
> > > Hi:
> > >
> > > In JMeter 3.2 I am running a simple HTTP POST json test on my own PC
> > > against processes also running on my PC. In total 150 requests are
> sent.
> > >
> > > I am still developing the test so I have both an Aggregate Report and
> > > Backend listener.
> > >
> > > My problem is that the numbers do not match e.g.
> > >
> > > Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
> > > The max is 1850ms in both, but the min is 147 in Aggregate Report and
> > 1122
> > > in InfluxDB.
> > >
> > > Is this a problem or do the number have different meanings?
> > >
> > > UIltimately I want to disable/remove the Aggregate Report.
> > >
> > > All help gratefully received
> > > ,
> > > Paul
> > >
> > > --
> > > *The information in this e-mail and any attachments is confidential. It
> > is
> > > intended solely for the addressee(s) named above. If you are not an
> > > intended recipient, please notify the sender and delete the message and
> > any
> > > attachments from your system. Any use, copying or disclosure of the
> > > contents is unauthorised unless expressly permitted. Any views
> expressed
> > in
> > > this message are those of the sender unless expressly stated to be
> those
> > of
> > > OpenJaw. Virus checking of emails and attachments is the responsibility
> > of
> > > the recipient and OpenJaw cannot accept responsibility for any loss or
> > > damage arising from the use of this email or attachments. OpenJaw
> > > Technologies Limited is a limited company registered in Ireland having
> > > registration number 353613 and registered office at Grattan Bridge
> > House, 1
> > > Ormond Quay Upper, Dublin 7.*
> > >
> >
>
> --
> *The information in this e-mail and any attachments is confidential. It is
> intended solely for the addressee(s) named above. If you are not an
> intended recipient, please notify the sender and delete the message and any
> attachments from your system. Any use, copying or disclosure of the
> contents is unauthorised unless expressly permitted. Any views expressed in
> this message are those of the sender unless expressly stated to be those of
> OpenJaw. Virus checking of emails and attachments is the responsibility of
> the recipient and OpenJaw cannot accept responsibility for any loss or
> damage arising from the use of this email or attachments. OpenJaw
> Technologies Limited is a limited company registered in Ireland having
> registration number 353613 and registered office at Grattan Bridge House, 1
> Ormond Quay Upper, Dublin 7.*
>
Re: Mismatch between numbers in Aggregate Report and InfluxDB via
backend listener
Posted by Paul Power <pa...@openjawtech.com>.
Many thanks Maxime:
I made these changes:
backend_metrics_window_mode=timed
backend_metrics_large_window=50000
The average, max and min are now correct. The 90%, 95% and 99% values are
still wrong.
Regards,
Paul
On 5 May 2017 at 16:26, Maxime Chassagneux <ma...@gmail.com>
wrote:
> Hi,
>
> Try to change the window mode of the backend metric to time boxed ( i.e in
> jmeter.properties and see "BackendListener - configuration" section ).
> So each 5 seconds, all metrics are send to influxdb and reset. ( no
> aggregation in a slidding window array )
>
> --
> Maxime
>
>
>
> 2017-05-05 15:16 GMT+02:00 Paul Power <pa...@openjawtech.com>:
>
> > Hi:
> >
> > In JMeter 3.2 I am running a simple HTTP POST json test on my own PC
> > against processes also running on my PC. In total 150 requests are sent.
> >
> > I am still developing the test so I have both an Aggregate Report and
> > Backend listener.
> >
> > My problem is that the numbers do not match e.g.
> >
> > Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
> > The max is 1850ms in both, but the min is 147 in Aggregate Report and
> 1122
> > in InfluxDB.
> >
> > Is this a problem or do the number have different meanings?
> >
> > UIltimately I want to disable/remove the Aggregate Report.
> >
> > All help gratefully received
> > ,
> > Paul
> >
> > --
> > *The information in this e-mail and any attachments is confidential. It
> is
> > intended solely for the addressee(s) named above. If you are not an
> > intended recipient, please notify the sender and delete the message and
> any
> > attachments from your system. Any use, copying or disclosure of the
> > contents is unauthorised unless expressly permitted. Any views expressed
> in
> > this message are those of the sender unless expressly stated to be those
> of
> > OpenJaw. Virus checking of emails and attachments is the responsibility
> of
> > the recipient and OpenJaw cannot accept responsibility for any loss or
> > damage arising from the use of this email or attachments. OpenJaw
> > Technologies Limited is a limited company registered in Ireland having
> > registration number 353613 and registered office at Grattan Bridge
> House, 1
> > Ormond Quay Upper, Dublin 7.*
> >
>
--
*The information in this e-mail and any attachments is confidential. It is
intended solely for the addressee(s) named above. If you are not an
intended recipient, please notify the sender and delete the message and any
attachments from your system. Any use, copying or disclosure of the
contents is unauthorised unless expressly permitted. Any views expressed in
this message are those of the sender unless expressly stated to be those of
OpenJaw. Virus checking of emails and attachments is the responsibility of
the recipient and OpenJaw cannot accept responsibility for any loss or
damage arising from the use of this email or attachments. OpenJaw
Technologies Limited is a limited company registered in Ireland having
registration number 353613 and registered office at Grattan Bridge House, 1
Ormond Quay Upper, Dublin 7.*
Re: Mismatch between numbers in Aggregate Report and InfluxDB via
backend listener
Posted by Maxime Chassagneux <ma...@gmail.com>.
Hi,
Try to change the window mode of the backend metric to time boxed ( i.e in
jmeter.properties and see "BackendListener - configuration" section ).
So each 5 seconds, all metrics are send to influxdb and reset. ( no
aggregation in a slidding window array )
--
Maxime
2017-05-05 15:16 GMT+02:00 Paul Power <pa...@openjawtech.com>:
> Hi:
>
> In JMeter 3.2 I am running a simple HTTP POST json test on my own PC
> against processes also running on my PC. In total 150 requests are sent.
>
> I am still developing the test so I have both an Aggregate Report and
> Backend listener.
>
> My problem is that the numbers do not match e.g.
>
> Average is 1566ms in Aggregate Report and 1649 in InfluxDB.
> The max is 1850ms in both, but the min is 147 in Aggregate Report and 1122
> in InfluxDB.
>
> Is this a problem or do the number have different meanings?
>
> UIltimately I want to disable/remove the Aggregate Report.
>
> All help gratefully received
> ,
> Paul
>
> --
> *The information in this e-mail and any attachments is confidential. It is
> intended solely for the addressee(s) named above. If you are not an
> intended recipient, please notify the sender and delete the message and any
> attachments from your system. Any use, copying or disclosure of the
> contents is unauthorised unless expressly permitted. Any views expressed in
> this message are those of the sender unless expressly stated to be those of
> OpenJaw. Virus checking of emails and attachments is the responsibility of
> the recipient and OpenJaw cannot accept responsibility for any loss or
> damage arising from the use of this email or attachments. OpenJaw
> Technologies Limited is a limited company registered in Ireland having
> registration number 353613 and registered office at Grattan Bridge House, 1
> Ormond Quay Upper, Dublin 7.*
>