You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@jmeter.apache.org by bu...@apache.org on 2020/07/21 09:47:59 UTC

[Bug 64617] New: 99,95,99th percentile appear below the Median in Response Time Percentiles Over Time Graph on html report.

https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

            Bug ID: 64617
           Summary: 99,95,99th percentile appear below the Median in
                    Response Time Percentiles Over Time Graph on html
                    report.
           Product: JMeter
           Version: 5.3
          Hardware: PC
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Main
          Assignee: issues@jmeter.apache.org
          Reporter: mitsumori@mis.dev
  Target Milestone: JMETER_5.3.1

Created attachment 37365
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=37365&action=edit
Differences between the graphs (Response Time Percentiles Over Time)

In the HTML report, the Response Time Percentiles Over Time (successful
responses) graph displays three percentile values: 90th percentile, 95th
percentile, and 99th percentile.
These 3 percentile values should indicate a longer response time than the
median (= 50th percentile). However, I have found that in the JMeter 5.3
graphs, the three percentile values are displayed below the Median.

If I create a report in JMeter 5.2.1 from the same log, the Response Time
Percentiles Over Time graph will be completely different.
Median, which is new in JMeter 5.3, is of course not shown. In addition to
that, the display of the three percentile values will be different.

I am reporting to Bugzilla for the first time. 
If there is any missing information, I will do my best to respond to it.

Thanks.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] 99,95,99th percentile appear below the Median in Response Time Percentiles Over Time Graph on html report.

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #4 from Hiroyoshi Mitsumori <mi...@mis.dev> ---
(In reply to Philippe Mouawad from comment #1)
> Thanks for report.
> 
> One clarification:
> - Did you use the different version to generate the Graphs only 
> - or did you run a test then generate with version 5.2.1 then run a test
> then generate with version 5.3 ?

I generated two reports from the one log files I created in version 5.3.


> Can you provide screenshots or the full report that shows this difference ?
> 
> Could you share:
> - JMX file
> - jmeter.log
> - CSV file for the 2 tests ?

I shared the two zip files.
It contains:
- JMX file
- CSV file(one file)
- jmeter.log(two files)

You can generate two different HTML reports from two versions of JMeter, 5.3
and 5.2.1, using the attached jtl file.

Thank you.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Hardware|PC                          |All
            Summary|90,95,99th percentile       |HTML report: In graph
                   |correspond in reality to    |Response Time Percentiles
                   |0.90, 0.95 and 0.99         |Over Time 90,95,99th
                   |percentiles                 |percentile correspond in
                   |                            |reality to 0.90, 0.95 and
                   |                            |0.99 percentiles
           Severity|normal                      |regression

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] 99,95,99th percentile appear below the Median in Response Time Percentiles Over Time Graph on html report.

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 OS|                            |All
                 CC|                            |p.mouawad@ubik-ingenierie.c
                   |                            |om
             Status|NEW                         |NEEDINFO

--- Comment #1 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Thanks for report.

One clarification:
- Did you use the different version to generate the Graphs only 
- or did you run a test then generate with version 5.2.1 then run a test then
generate with version 5.3 ?

Can you provide screenshots or the full report that shows this difference ?

Could you share:
- JMX file
- jmeter.log
- CSV file for the 2 tests ?

Thank you
Regards

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] 99,95,99th percentile appear below the Median in Response Time Percentiles Over Time Graph on html report.

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #2 from Hiroyoshi Mitsumori <mi...@mis.dev> ---
Created attachment 37369
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=37369&action=edit
jmx file and jtl file

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #7 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Thanks a lot for reporting this critical regression !

Can you test nightly build that will be generated tonight and available
tomorrow ?
Thanks

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|99,95,99th percentile       |90,95,99th percentile
                   |appear below the Median in  |correspond in reality to
                   |Response Time Percentiles   |0.90, 0.95 and 0.99
                   |Over Time Graph on html     |percentiles
                   |report.                     |

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #8 from Hiroyoshi Mitsumori <mi...@mis.dev> ---
I have confirmed that the graphs are working correctly in Nightly Build.
Thanks for your great work.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |FixedInTrunk
         Resolution|---                         |FIXED
             Status|NEEDINFO                    |RESOLVED

--- Comment #6 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
pmouawad pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/jmeter.git


The following commit(s) were added to refs/heads/master by this push:
     new 5d47043  Bug 64617 - HTML report: In graph Response Time Percentiles
Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99
percentiles
5d47043 is described below

commit 5d470437c87f2807af317284a2d9372d03db987a
Author: pmouawad <p....@ubik-ingenierie.com>
AuthorDate: Sat Jul 25 22:14:55 2020 +0200

    Bug 64617 - HTML report: In graph Response Time Percentiles Over Time
    90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99
    percentiles
---
 .../graph/impl/ResponseTimePercentilesOverTimeGraphConsumer.java     | 5 +----
 xdocs/changes.xml                                                    | 2 ++
 2 files changed, 3 insertions(+), 4 deletions(-)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] HTML report: In graph Response Time Percentiles Over Time 90,95,99th percentile correspond in reality to 0.90, 0.95 and 0.99 percentiles

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #5 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Issue has been introduced by :
https://github.com/apache/jmeter/commit/9a8ca629dec1bf70444161988481399332434173

Related to Bug 64380

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 64617] 99,95,99th percentile appear below the Median in Response Time Percentiles Over Time Graph on html report.

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=64617

--- Comment #3 from Hiroyoshi Mitsumori <mi...@mis.dev> ---
Created attachment 37370
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=37370&action=edit
jmeter.log

-- 
You are receiving this mail because:
You are the assignee for the bug.