You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@jmeter.apache.org by bu...@apache.org on 2013/04/19 16:51:14 UTC

[Bug 54867] New: Degraded performance between 2.5.3 and 2.9

https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

            Bug ID: 54867
           Summary: Degraded performance between 2.5.3 and 2.9
           Product: JMeter
           Version: 2.9
          Hardware: PC
                OS: Linux
            Status: NEW
          Severity: regression
          Priority: P2
         Component: HTTP
          Assignee: issues@jmeter.apache.org
          Reporter: lucas.pouzac.pro@gmail.com
    Classification: Unclassified

Created attachment 30211
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=30211&action=edit
Screenshot

Performance in a standard http call were degraded between 2.5.1 and version 2.9
(see screenshot)

The test is really easy. Just add a mock perl on apache with a tempo of 10ms.

Apache conf (/etc/httpd/conf.d/jmeter.conf)
<VirtualHost *:80>
        ServerName jmeter.com
        ServerAlias www.jmeter.com
        DocumentRoot "/var/www/html"

        Alias /test.php /var/www/html/perl/jmeter.pl

</VirtualHost>

Perl script (/var/www/html/perl/jmeter.pl)
#!/usr/bin/perl
    use strict;
    use CGI;
    my $cgi = new CGI;

    use Time::HiRes;
    Time::HiRes::sleep(0.01);

    print "Content-type: text/html\r\n\r\n";
    print "JMeter test";


JMeter script
query : http://serveur/test.php
users : 10
time : 30 sec

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #5 from Lucas Pouzac <lu...@gmail.com> ---
Created attachment 30213
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=30213&action=edit
JMX plan

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #18 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Which reporting plugin was it ?

Anyway thanks for follow up.
Merci

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #9 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Also you test is very short (30s), could you make it last 1 minute and add a
startup delay of 10 s ?

Are you running jmeter from same machine as PHP ?

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #14 from Lucas Pouzac <lu...@gmail.com> ---
Created attachment 30220
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=30220&action=edit
JMeter comparaisons

Here are the results of the various tests I performed today.
My tests do not show, in fact, real problems.

I still continues an analysis as I see all the same degradation following the
transition to version 2.9 on my application scenarios.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #10 from Lucas Pouzac <lu...@gmail.com> ---
Monday because I'm not at work ;)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #11 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
If you can also try a test with disabling "Rapport consolidé" listener and just
this:
<JMETER_HOME>/bin/jmeter -t <Path to Test Plan> -n -l <path to
results>/results.csv

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #8 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Final request, can you test with nightly build ?

http://ci.apache.org/projects/jmeter/nightlies/



Installing JMeter runtime
Download the _bin and _lib files
Unpack the archives into the same directory structure
The other archives are not needed to run JMeter. 

Thanks

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #13 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Hello,
Your JTL results are strange:
- 2.5.1 seems for example to report different response sizes for messages, the
"by" field has different values. are you sure the php page didn't change
between this test and the others? 


Would it be possible to do a test also with HTTP Client 3.1 ?

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO
                 CC|                            |p.mouawad@ubik-ingenierie.c
                   |                            |om

--- Comment #1 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Can you do the same test in NON GUI mode ?
See this discussion:
http://mail-archives.apache.org/mod_mbox/jmeter-user/201304.mbox/%3C201304091053.51742.kostas%40methodosit.com.cy%3E

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #15 from Lucas Pouzac <lu...@gmail.com> ---
Maybe, could you add value for "enabled" attribute which allow disable
ResultCollector (and more ?) with non gui mode automaticaly ?

By example : 
 - enabled = true (already enable)
 - enabled = false (already disable)
 - enabled = gui (only gui mode)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #4 from Lucas Pouzac <lu...@gmail.com> ---
Created attachment 30212
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=30212&action=edit
JTL non GUI (2.5.1 and 2.9)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #16 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Hello Lucas,
First many thanks for your investigations.

Second:
- Did you make tests using HC3
- In Test 2, did you make tests with current trunk ?

Your idea seems to me good one at first look, could you open another Bugzilla
for it ?


How must we understand this:
"My tests do not show, in fact, real problems.

I still continues an analysis as I see all the same degradation following the
transition to version 2.9 on my application scenarios."

I understand this:
- The following tests mentionned here do not show problems
- But you have degradations following transition to version 2.9 on your app
scenarios ?

If so maybe open a discussion on user list, maybe you can have some help.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #3 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Can you attach you JMX plan ?

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #12 from Lucas Pouzac <lu...@gmail.com> ---
apache server and jmeter are on two different servers

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

--- Comment #7 from Lucas Pouzac <lu...@gmail.com> ---
Created attachment 30214
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=30214&action=edit
JTL non GUI (2.5.1, 2.7, 2.8 and 2.9)

Count (httpSample)
test-nongui-2.5.1.jtl:23138
test-nongui-2.7.0.jtl:22655
test-nongui-2.8.0.jtl:21621
test-nongui-2.9.0.jtl:21822

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO

--- Comment #6 from Philippe Mouawad <p....@ubik-ingenierie.com> ---
Thanks very much, if you have time it would be great from you to test with 2.8
in NON GUI mode

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

Lucas Pouzac <lu...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |NEW

--- Comment #2 from Lucas Pouzac <lu...@gmail.com> ---
I observed the same problem to non gui mode (cf pj)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 54867] Degraded performance between 2.5.3 and 2.9

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=54867

Lucas Pouzac <lu...@gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |RESOLVED
         Resolution|---                         |INVALID

--- Comment #17 from Lucas Pouzac <lu...@gmail.com> ---
"But you have degradations following transition to version 2.9 on your app
scenarios ?"

In fact, I also updated the reporting plugin. A bug existed, but after
correction, all came back fine.

-- 
You are receiving this mail because:
You are the assignee for the bug.