You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@jmeter.apache.org by bu...@apache.org on 2011/12/15 10:17:59 UTC

DO NOT REPLY [Bug 52339] New: JMeter Statistical mode in distributed testing shows wrong response time

https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

             Bug #: 52339
           Summary: JMeter Statistical mode in distributed testing shows
                    wrong response time
           Product: JMeter
           Version: Nightly (Please specify date)
          Platform: All
        OS/Version: Windows Server 2003
            Status: NEW
          Severity: regression
          Priority: P2
         Component: Main
        AssignedTo: issues@jmeter.apache.org
        ReportedBy: liu_xp2003@yahoo.com.cn
    Classification: Unclassified


Depoly latest JMeter NightBuild on two machines [apache-jmeter-r1214179
15-Dec-2011 02:38]

Steps:
1. Start one machine as JMeter server.
2. Update JMeter client jmeter.properties to use mode=Statistical on another
machine.
3. Add JMeter server to remote_hosts
3. Start Jmeter client.
4. Open a http test script with some simple http request [about 20 threads and
20 loop]
5. Run script on JMeter client. [In Aggregate Report: Average response is 32ms
and Max response is 145ms]
6. Run same script by JMeter server. [in Aggregate Report: Average response is
1464ms and Max response is 2098ms]

The Statistical mode couldn't get correct response time in distributed testing.

JMeter 2.5.1 release version doesn't have the issue.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #14 from Christ <li...@yahoo.com.cn> 2011-12-17 15:47:20 UTC ---
Summary Report is correct in apache-jmeter-r1214179 build.
Aggregate Report is incorrect in apache-jmeter-r1214179 build.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #9 from Christ <li...@yahoo.com.cn> 2011-12-17 13:53:16 UTC ---
Created attachment 28082
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=28082
JMeter log for Bug 52339

Run_C-S_clientLog.zip and Run_C-S_serverLog.zip is the first run log.
Run_no-GUI_serverlog.zip is the second run log.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Christ <li...@yahoo.com.cn> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |NEW

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Christ <li...@yahoo.com.cn> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |NEW

--- Comment #10 from Christ <li...@yahoo.com.cn> 2011-12-17 14:01:41 UTC ---
The problem is not happened when running as non-GUI on the server node.
jmeter.properties has not been changed on server node.
run command:
jmeter -n -t Sample_JMeterBug_52339.jmx -l runNOGUI-onJMeterServer.jtl

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Sebb <se...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO

--- Comment #12 from Sebb <se...@apache.org> 2011-12-17 14:32:25 UTC ---
Looks like the problem might have been caused by the fix for Bug 52125.

In the meantime, use Summary Report rather than Aggregate Report and the
display problem should go away.

Please can you confirm if that fixes the issue?

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Philippe Mouawad <p....@ubik-ingenierie.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |p.mouawad@ubik-ingenierie.c
                   |                            |om
         Depends on|                            |52125
         OS/Version|Windows Server 2003         |All

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #4 from Christ <li...@yahoo.com.cn> 2011-12-15 15:21:10 UTC ---
Created attachment 28075
  --> https://issues.apache.org/bugzilla/attachment.cgi?id=28075
JAVA sample script to reproduce the problem

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #11 from Sebb <se...@apache.org> 2011-12-17 14:21:51 UTC ---
Thanks for the JTL files - I think I've found the problem.

Try using Summary Report instead of Aggregate Report, and the figures look OK.

Seems that Aggregate report is not allowing for the fact that Statistical
results represent multiple samples.

I'll try and post a fix for that shortly.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Sebb <se...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED

--- Comment #15 from Sebb <se...@apache.org> 2011-12-20 20:51:32 UTC ---
Also fixes Bug 52125

URL: http://svn.apache.org/viewvc?rev=1221486&view=rev
Log:
Bug 52339 - JMeter Statistical mode in distributed testing shows wrong response
time<

Modified:
   jmeter/trunk/src/jorphan/org/apache/jorphan/math/StatCalculator.java
   jmeter/trunk/src/jorphan/org/apache/jorphan/math/StatCalculatorInteger.java
   jmeter/trunk/src/jorphan/org/apache/jorphan/math/StatCalculatorLong.java
   jmeter/trunk/test/src/org/apache/jorphan/math/TestStatCalculator.java
   jmeter/trunk/xdocs/changes.xml

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Christ <li...@yahoo.com.cn> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |NEW

--- Comment #5 from Christ <li...@yahoo.com.cn> 2011-12-15 15:22:09 UTC ---
The issue could be reproduced by JavaTest class.
I attached script. It could help you reproduce the issue.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #2 from Christ <li...@yahoo.com.cn> 2011-12-15 13:40:38 UTC ---
I have verified with Standard,Batch,Hold and Statistical mode. It was only
occurred on Statistical mode.
I have justed checked with BeanShell Sampler. Both of HTTP and BeanShell
sampler have this problem.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #6 from Sebb <se...@apache.org> 2011-12-16 11:40:20 UTC ---
I'm still not seeing the problem, but have not yet been able to test across two
different physical hosts.

Also I don't see anything obvious in the changes to StatisticalSampleSender
since 2.5.1.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #7 from Christ <li...@yahoo.com.cn> 2011-12-17 06:48:07 UTC ---
I have recorded about the problem with video.
And you can download from the URL "http://speedy.sh/RfBCj/JMeter-Bug52339.zip"
to review it.[The file size is about 5.14MB. MD5:
43F7E75749DFFC778B7C53864271550A]
I have made it to execution file. You can open it directly to replay it.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Sebb <se...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO

--- Comment #3 from Sebb <se...@apache.org> 2011-12-15 14:30:21 UTC ---
Can you try with Java Sampler please?

I cannot reproduce the problem.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Christ <li...@yahoo.com.cn> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |NEW

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Bug 52339 depends on bug 52125, which changed state.

Bug 52125 Summary: StatCalculator.addAll(StatCalculator<T> calc) joins incorrect if there are more samples with the same response time in one of the TreeMap
https://issues.apache.org/bugzilla/show_bug.cgi?id=52125

           What    |Old Value                   |New Value
----------------------------------------------------------------------------
             Status|REOPENED                    |RESOLVED
         Resolution|                            |FIXED

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Sebb <se...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO

--- Comment #8 from Sebb <se...@apache.org> 2011-12-17 11:02:24 UTC ---
Can you run the Java test sample you provided, and attach the following output:

jmeter.log from client and server systems
JTL file from the run (make sure subsamples are saved).

Also, please do the same for the test run as non-GUI on the server node.
Obviously in that case cannot use Statistical mode.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

Sebb <se...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |NEEDINFO

--- Comment #1 from Sebb <se...@apache.org> 2011-12-15 10:23:02 UTC ---
Is it only statistical mode that has the problem?

Does the same problem occur if you replace the HTTP samplers with Java
samplers?
This will eliminate the effects of accessing the server from different hosts.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

DO NOT REPLY [Bug 52339] JMeter Statistical mode in distributed testing shows wrong response time

Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=52339

--- Comment #13 from Christ <li...@yahoo.com.cn> 2011-12-17 15:43:57 UTC ---
Revision 1197375 is ok for Aggregate Report.

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.