You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by sprasad <sp...@gmail.com> on 2011/08/20 06:40:45 UTC
If i do a manual execution by adding extended status bar to firefox
Hi,
If i do a manual execution by adding extended status bar to firefox the
response time i am getting is much higher for one user, but when i run the
same navigation(s) through JMeter script its giving a very less value and
moreover it is run for multiple users.
How one should be interpreting this?
Thanks,
Sd.
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4717698.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: prasad sadu wants to chat
Posted by sebb <se...@gmail.com>.
On 20 August 2011 07:50, sprasad <sp...@gmail.com> wrote:
> -----------------------------------------------------------------------
>
> prasad sadu wants to stay in better touch using some of Google's coolest new
> products.
This is off-topic for the JMeter mailing list (or indeed most mailing lists).
Please refrain from sending such e-mails in future, or it may be
necessary to cancel your subscription.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
prasad sadu wants to chat
Posted by sprasad <sp...@gmail.com>.
-----------------------------------------------------------------------
prasad sadu wants to stay in better touch using some of Google's coolest new
products.
If you already have Gmail or Google Talk, visit:
http://mail.google.com/mail/b-17653af17a-c037036762-CDX2sVNDRsjLWXecpAg66vfZosc
You'll need to click this link to be able to chat with prasad sadu.
To get Gmail - a free email account from Google with over 2,800 megabytes of
storage - and chat with prasad sadu, visit:
http://mail.google.com/mail/a-17653af17a-c037036762-CDX2sVNDRsjLWXecpAg66vfZosc
Gmail offers:
- Instant messaging right inside Gmail
- Powerful spam protection
- Built-in search for finding your messages and a helpful way of organizing
emails into "conversations"
- No pop-up ads or untargeted banners - just text ads and related information
that are relevant to the content of your messages
All this, and its yours for free. But wait, there's more! By opening a Gmail
account, you also get access to Google Talk, Google's instant messaging
service:
http://www.google.com/talk/
Google Talk offers:
- Web-based chat that you can use anywhere, without a download
- A contact list that's synchronized with your Gmail account
- Free, high quality PC-to-PC voice calls when you download the Google Talk
client
We're working hard to add new features and make improvements, so we might also
ask for your comments and suggestions periodically. We appreciate your help in
making our products even better!
Thanks,
The Google Team
To learn more about Gmail and Google Talk, visit:
http://mail.google.com/mail/help/about.html
http://www.google.com/talk/about.html
(If clicking the URLs in this message does not work, copy and paste them into
the address bar of your browser).
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4717874.html
Sent from the JMeter - User mailing list archive at Nabble.com.
Re: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
Bruce, Thanks a ton!
Sd.
On Sat, Oct 1, 2011 at 2:17 PM, sebb-2-2 [via JMeter] <
ml-node+s512774n4859275h35@n5.nabble.com> wrote:
> On 1 October 2011 06:07, sprasad <[hidden email]<http://user/SendEmail.jtp?type=node&node=4859275&i=0>>
> wrote:
> > I have calculated manually by adding up all the response times in
> 'Average'
> > column and divided by number of labels, in my case that would
> > 3920/7=560....if i divide it by 1000 to show it in seconds it would 0.56,
>
> > but here the value is 0.66 which i got in aggregate report...
>
> You cannot average averages buy adding them, unless each average
> represents the same number of samples.
>
> You have to multiply each average by the number of samples it
> represents, add them all together, then divide by the total number of
> samples.
>
> > actually the table which i have given you is aggregate report of a simple
>
> > login test script of my application, instead of the URL I have just given
>
> > numbers. This Login has been run for 25 users - total 7 navigations
> >
> > One more thing you said last row value is not much useful ? then which
> value
> > should we consider to say that, you know, this login is taking "this"
> amount
> > of time for N number of users.??
> >
> > Is Min. and Max. values against the labels are the response time (in
> > milliseconds) for that particular label/navigation - right ???
>
> Yes.
>
> > Thanks,
> > Sd
> >
> >
> >
> >
> >
> > On Fri, Sep 30, 2011 at 10:25 PM, shettyd [via JMeter] <
> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4859275&i=1>>
> wrote:
> >
> >> how have you calculated it manually (the last row value is not much
> useful
> >> anyway)?
> >> If Request1 = 10 samples each 10 secs therefore avg =10 seconds
> >> and request2 = 1 sample , 1 second therefore avg = 1 second
> >> then overall average = (10*10 + 1*1)seconds/(10+1) samples.
> >>
> >>
> >>
> >> regards
> >> deepak
> >>
> >>
> >> On Thu, Sep 29, 2011 at 11:50 PM, sprasad <[hidden email]<
> http://user/SendEmail.jtp?type=node&node=4857796&i=0>>
> >> wrote:
> >>
> >> > Hi Oliver,
> >> >
> >> > I have a small () question for you -
> >> >
> >> > I am running some tests and presenting the aggregate report - in this,
>
> >> > Average Response Time, which is the second column in agg. report table
> is
> >>
> >> > the "average of set of response times", but the the value displayed in
>
> >> the
> >> > last row - Total - and under Average column is not matching up when i
> do
> >> > the
> >> > average of response times manually.
> >> >
> >> > For ex, have a look at the below table: I have taken Average in
> seconds.
> >> > The
> >> > Average *0.66* in the last row is not matching up when i do the
> average
> >> of
> >> > the response time manually. Also, Min and Max represent the min.
> response
> >>
> >> > time and max. response time for that particular label (navigation) -
> >> right
> >> > ?
> >> >
> >> >
> >> > *Label*
> >> >
> >> > *Samples*
> >> >
> >> > *Average (s)*
> >> >
> >> > *Median*
> >> >
> >> > *90%Line*
> >> >
> >> > *Min*
> >> >
> >> > *Max*
> >> >
> >> > *Error%*
> >> >
> >> > *Throughput*
> >> >
> >> > *KB/Sec*
> >> >
> >> > URL
> >> >
> >> > 75
> >> >
> >> > 1.00
> >> >
> >> > 749
> >> >
> >> > 3019
> >> >
> >> > 27
> >> >
> >> > 6035
> >> >
> >> > 0
> >> >
> >> > 8.39
> >> >
> >> > 164.26
> >> >
> >> > 1
> >> >
> >> > 50
> >> >
> >> > 0.63
> >> >
> >> > 34
> >> >
> >> > 2978
> >> >
> >> > 20
> >> >
> >> > 6031
> >> >
> >> > 0
> >> >
> >> > 7.38
> >> >
> >> > 53.07
> >> >
> >> > Login Page
> >> >
> >> > 25
> >> >
> >> > 0.14
> >> >
> >> > 17
> >> >
> >> > 33
> >> >
> >> > 12
> >> >
> >> > 3009
> >> >
> >> > 0
> >> >
> >> > 3.74
> >> >
> >> > 25.02
> >> >
> >> > 2
> >> >
> >> > 25
> >> >
> >> > 0.13
> >> >
> >> > 9
> >> >
> >> > 16
> >> >
> >> > 7
> >> >
> >> > 2939
> >> >
> >> > 0
> >> >
> >> > 3.74
> >> >
> >> > 5.69
> >> >
> >> > 3
> >> >
> >> > 25
> >> >
> >> > 1.10
> >> >
> >> > 864
> >> >
> >> > 1120
> >> >
> >> > 306
> >> >
> >> > 4106
> >> >
> >> > 0
> >> >
> >> > 3.36
> >> >
> >> > 146.53
> >> >
> >> > 4 Home Page
> >> >
> >> > 25
> >> >
> >> > 0.87
> >> >
> >> > 957
> >> >
> >> > 1028
> >> >
> >> > 234
> >> >
> >> > 1038
> >> >
> >> > 0
> >> >
> >> > 2.78
> >> >
> >> > 121.36
> >> >
> >> > 5
> >> >
> >> > 25
> >> >
> >> > 0.05
> >> >
> >> > 52
> >> >
> >> > 59
> >> >
> >> > 30
> >> >
> >> > 77
> >> >
> >> > 0
> >> >
> >> > 2.86
> >> >
> >> > 7.46
> >> >
> >> > *TOTAL*
> >> >
> >> > *250*
> >> >
> >> > *0.66*
> >> >
> >> > *58*
> >> >
> >> > *2961*
> >> >
> >> > *7*
> >> >
> >> > *6035*
> >> >
> >> > *0*
> >> >
> >> > *24.94*
> >> >
> >> > *427.27*
> >> >
> >> >
> >> > Please clear my doubts.
> >> >
> >> > Thanks,
> >> > Sd
> >> >
> >> >
> >> > On Sat, Aug 20, 2011 at 5:11 PM, Oliver Lloyd [via JMeter] <
> >> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4857796&i=1>>
>
> >> wrote:
> >> >
> >> > > The problem here is you are trying to do something that is
> essentially
> >> > not
> >> > > possible and, crucially, not useful.
> >> > >
> >> > > JMeter is not a browser so it will never give you the exact same
> >> response
> >> > > times for rendering a page as you see in your browser. Indeed,
> >> different
> >> > > browsers themselves will give you different page load times so
> there's
> >> > > really no point worrying about the difference.
> >> > >
> >> > > What you really need to do is work out your objectives - what are
> you
> >> > > trying to do? What are your requirements for testing? You should
> >> qualify
> >> > in
> >> > > verbal terms what you what to achieve and then prove the same using
> >> your
> >> > > tests. Then you should quantify these statements to create actual
> >> targets
> >> > to
> >> > > aim for, giving you pass / fail criteria. Having objectives is
> >> especially
> >> > > important when thinking about 'rendering' the full page because this
>
> >> > > experience is effected by multiple things and needs to be understood
>
> >> and
> >> > > planned for. For example, do you even want to simulate page
> resources?
> >> > Are
> >> > > you using a CDN? Are there any other types of caches that you need
> to
> >> > take
> >> > > account of when designing your load?
> >> > >
> >> > > Based on the requirements you then go away and design a test that
> meets
> >>
> >> > > them. If page rendering is in scope, if you want to validate the
> client
> >>
> >> > side
> >> > > performance, then this is more of a functional activity - you cannot
>
> >> use
> >> > a
> >> > > tool like JMeter to test this. In fact you don't need a 'tool' to do
>
> >> this
> >> > at
> >> > > all, just a mouse and keyboard will suffice. Client side performance
> is
> >>
> >> > > crucial - there are lots of things to be considered and tuned for -
> but
> >>
> >> > it
> >> > > is not really relevant in this forum.
> >> > >
> >> > > So, in short, page load times and server response are part of the
> same
> >> > user
> >> > > experience but need to be approached in different manners - this is
> an
> >> > age
> >> > > old principle of performance testing which is routinely
> misunderstood.
> >> > >
> >> > > If you can't get your head around this then these days you can solve
>
> >> the
> >> > > problem by paying an external company to run tests where each script
>
> >> runs
> >> > in
> >> > > it's own browser (the Cloud makes this possible) or you can go down
> the
> >>
> >> > > hybrid path and use another (rather well known) load test tool that
> >> gives
> >> > > you GUI like scripts that almost run full browsers. If you don't
> have
> >> the
> >> > > budget for this then JMeter offers an excellent solution, however
> >> without
> >> > a
> >> > > basic foundation knowledge of computing you're very unlikely to do a
>
> >> good
> >> > > job.
> >> > >
> >> > > ------------------------------
> >> > > If you reply to this email, your message will be added to the
> >> discussion
> >> > > below:
> >> > >
> >> > >
> >> >
> >>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
> >> > > To unsubscribe from If i do a manual execution by adding extended
> >> status
> >> > > bar to firefox, click here<
> >> >
> >> >.
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > View this message in context:
> >> >
> >>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4856044.html
> >>
> >> > Sent from the JMeter - User mailing list archive at Nabble.com.
> >> >
> >>
> >>
> >> ------------------------------
> >> If you reply to this email, your message will be added to the
> discussion
> >> below:
> >>
> >>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4857796.html
> >> To unsubscribe from If i do a manual execution by adding extended
> status
> >> bar to firefox, click here<
>
> >>
> >>
> >
> >
> > --
> > View this message in context:
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4859100.html
>
> > Sent from the JMeter - User mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]<http://user/SendEmail.jtp?type=node&node=4859275&i=2>
> For additional commands, e-mail: [hidden email]<http://user/SendEmail.jtp?type=node&node=4859275&i=3>
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4859275.html
> To unsubscribe from If i do a manual execution by adding extended status
> bar to firefox, click here<http://jmeter.512774.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4717698&code=c3ByYXNhZC5zYWR1QGdtYWlsLmNvbXw0NzE3Njk4fC0xNDM4OTcyNzI4>.
>
>
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4863833.html
Sent from the JMeter - User mailing list archive at Nabble.com.
Re: If i do a manual execution by adding extended status bar to firefox
Posted by sebb <se...@gmail.com>.
On 1 October 2011 06:07, sprasad <sp...@gmail.com> wrote:
> I have calculated manually by adding up all the response times in 'Average'
> column and divided by number of labels, in my case that would
> 3920/7=560....if i divide it by 1000 to show it in seconds it would 0.56,
> but here the value is 0.66 which i got in aggregate report...
You cannot average averages buy adding them, unless each average
represents the same number of samples.
You have to multiply each average by the number of samples it
represents, add them all together, then divide by the total number of
samples.
> actually the table which i have given you is aggregate report of a simple
> login test script of my application, instead of the URL I have just given
> numbers. This Login has been run for 25 users - total 7 navigations
>
> One more thing you said last row value is not much useful ? then which value
> should we consider to say that, you know, this login is taking "this" amount
> of time for N number of users.??
>
> Is Min. and Max. values against the labels are the response time (in
> milliseconds) for that particular label/navigation - right ???
Yes.
> Thanks,
> Sd
>
>
>
>
>
> On Fri, Sep 30, 2011 at 10:25 PM, shettyd [via JMeter] <
> ml-node+s512774n4857796h86@n5.nabble.com> wrote:
>
>> how have you calculated it manually (the last row value is not much useful
>> anyway)?
>> If Request1 = 10 samples each 10 secs therefore avg =10 seconds
>> and request2 = 1 sample , 1 second therefore avg = 1 second
>> then overall average = (10*10 + 1*1)seconds/(10+1) samples.
>>
>>
>>
>> regards
>> deepak
>>
>>
>> On Thu, Sep 29, 2011 at 11:50 PM, sprasad <[hidden email]<http://user/SendEmail.jtp?type=node&node=4857796&i=0>>
>> wrote:
>>
>> > Hi Oliver,
>> >
>> > I have a small () question for you -
>> >
>> > I am running some tests and presenting the aggregate report - in this,
>> > Average Response Time, which is the second column in agg. report table is
>>
>> > the "average of set of response times", but the the value displayed in
>> the
>> > last row - Total - and under Average column is not matching up when i do
>> > the
>> > average of response times manually.
>> >
>> > For ex, have a look at the below table: I have taken Average in seconds.
>> > The
>> > Average *0.66* in the last row is not matching up when i do the average
>> of
>> > the response time manually. Also, Min and Max represent the min. response
>>
>> > time and max. response time for that particular label (navigation) -
>> right
>> > ?
>> >
>> >
>> > *Label*
>> >
>> > *Samples*
>> >
>> > *Average (s)*
>> >
>> > *Median*
>> >
>> > *90%Line*
>> >
>> > *Min*
>> >
>> > *Max*
>> >
>> > *Error%*
>> >
>> > *Throughput*
>> >
>> > *KB/Sec*
>> >
>> > URL
>> >
>> > 75
>> >
>> > 1.00
>> >
>> > 749
>> >
>> > 3019
>> >
>> > 27
>> >
>> > 6035
>> >
>> > 0
>> >
>> > 8.39
>> >
>> > 164.26
>> >
>> > 1
>> >
>> > 50
>> >
>> > 0.63
>> >
>> > 34
>> >
>> > 2978
>> >
>> > 20
>> >
>> > 6031
>> >
>> > 0
>> >
>> > 7.38
>> >
>> > 53.07
>> >
>> > Login Page
>> >
>> > 25
>> >
>> > 0.14
>> >
>> > 17
>> >
>> > 33
>> >
>> > 12
>> >
>> > 3009
>> >
>> > 0
>> >
>> > 3.74
>> >
>> > 25.02
>> >
>> > 2
>> >
>> > 25
>> >
>> > 0.13
>> >
>> > 9
>> >
>> > 16
>> >
>> > 7
>> >
>> > 2939
>> >
>> > 0
>> >
>> > 3.74
>> >
>> > 5.69
>> >
>> > 3
>> >
>> > 25
>> >
>> > 1.10
>> >
>> > 864
>> >
>> > 1120
>> >
>> > 306
>> >
>> > 4106
>> >
>> > 0
>> >
>> > 3.36
>> >
>> > 146.53
>> >
>> > 4 Home Page
>> >
>> > 25
>> >
>> > 0.87
>> >
>> > 957
>> >
>> > 1028
>> >
>> > 234
>> >
>> > 1038
>> >
>> > 0
>> >
>> > 2.78
>> >
>> > 121.36
>> >
>> > 5
>> >
>> > 25
>> >
>> > 0.05
>> >
>> > 52
>> >
>> > 59
>> >
>> > 30
>> >
>> > 77
>> >
>> > 0
>> >
>> > 2.86
>> >
>> > 7.46
>> >
>> > *TOTAL*
>> >
>> > *250*
>> >
>> > *0.66*
>> >
>> > *58*
>> >
>> > *2961*
>> >
>> > *7*
>> >
>> > *6035*
>> >
>> > *0*
>> >
>> > *24.94*
>> >
>> > *427.27*
>> >
>> >
>> > Please clear my doubts.
>> >
>> > Thanks,
>> > Sd
>> >
>> >
>> > On Sat, Aug 20, 2011 at 5:11 PM, Oliver Lloyd [via JMeter] <
>> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4857796&i=1>>
>> wrote:
>> >
>> > > The problem here is you are trying to do something that is essentially
>> > not
>> > > possible and, crucially, not useful.
>> > >
>> > > JMeter is not a browser so it will never give you the exact same
>> response
>> > > times for rendering a page as you see in your browser. Indeed,
>> different
>> > > browsers themselves will give you different page load times so there's
>> > > really no point worrying about the difference.
>> > >
>> > > What you really need to do is work out your objectives - what are you
>> > > trying to do? What are your requirements for testing? You should
>> qualify
>> > in
>> > > verbal terms what you what to achieve and then prove the same using
>> your
>> > > tests. Then you should quantify these statements to create actual
>> targets
>> > to
>> > > aim for, giving you pass / fail criteria. Having objectives is
>> especially
>> > > important when thinking about 'rendering' the full page because this
>> > > experience is effected by multiple things and needs to be understood
>> and
>> > > planned for. For example, do you even want to simulate page resources?
>> > Are
>> > > you using a CDN? Are there any other types of caches that you need to
>> > take
>> > > account of when designing your load?
>> > >
>> > > Based on the requirements you then go away and design a test that meets
>>
>> > > them. If page rendering is in scope, if you want to validate the client
>>
>> > side
>> > > performance, then this is more of a functional activity - you cannot
>> use
>> > a
>> > > tool like JMeter to test this. In fact you don't need a 'tool' to do
>> this
>> > at
>> > > all, just a mouse and keyboard will suffice. Client side performance is
>>
>> > > crucial - there are lots of things to be considered and tuned for - but
>>
>> > it
>> > > is not really relevant in this forum.
>> > >
>> > > So, in short, page load times and server response are part of the same
>> > user
>> > > experience but need to be approached in different manners - this is an
>> > age
>> > > old principle of performance testing which is routinely misunderstood.
>> > >
>> > > If you can't get your head around this then these days you can solve
>> the
>> > > problem by paying an external company to run tests where each script
>> runs
>> > in
>> > > it's own browser (the Cloud makes this possible) or you can go down the
>>
>> > > hybrid path and use another (rather well known) load test tool that
>> gives
>> > > you GUI like scripts that almost run full browsers. If you don't have
>> the
>> > > budget for this then JMeter offers an excellent solution, however
>> without
>> > a
>> > > basic foundation knowledge of computing you're very unlikely to do a
>> good
>> > > job.
>> > >
>> > > ------------------------------
>> > > If you reply to this email, your message will be added to the
>> discussion
>> > > below:
>> > >
>> > >
>> >
>> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
>> > > To unsubscribe from If i do a manual execution by adding extended
>> status
>> > > bar to firefox, click here<
>> >
>> >.
>> > >
>> > >
>> >
>> >
>> > --
>> > View this message in context:
>> >
>> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4856044.html
>>
>> > Sent from the JMeter - User mailing list archive at Nabble.com.
>> >
>>
>>
>> ------------------------------
>> If you reply to this email, your message will be added to the discussion
>> below:
>>
>> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4857796.html
>> To unsubscribe from If i do a manual execution by adding extended status
>> bar to firefox, click here<http://jmeter.512774.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4717698&code=c3ByYXNhZC5zYWR1QGdtYWlsLmNvbXw0NzE3Njk4fC0xNDM4OTcyNzI4>.
>>
>>
>
>
> --
> View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4859100.html
> Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
I have calculated manually by adding up all the response times in 'Average'
column and divided by number of labels, in my case that would
3920/7=560....if i divide it by 1000 to show it in seconds it would 0.56,
but here the value is 0.66 which i got in aggregate report...
actually the table which i have given you is aggregate report of a simple
login test script of my application, instead of the URL I have just given
numbers. This Login has been run for 25 users - total 7 navigations
One more thing you said last row value is not much useful ? then which value
should we consider to say that, you know, this login is taking "this" amount
of time for N number of users.??
Is Min. and Max. values against the labels are the response time (in
milliseconds) for that particular label/navigation - right ???
Thanks,
Sd
On Fri, Sep 30, 2011 at 10:25 PM, shettyd [via JMeter] <
ml-node+s512774n4857796h86@n5.nabble.com> wrote:
> how have you calculated it manually (the last row value is not much useful
> anyway)?
> If Request1 = 10 samples each 10 secs therefore avg =10 seconds
> and request2 = 1 sample , 1 second therefore avg = 1 second
> then overall average = (10*10 + 1*1)seconds/(10+1) samples.
>
>
>
> regards
> deepak
>
>
> On Thu, Sep 29, 2011 at 11:50 PM, sprasad <[hidden email]<http://user/SendEmail.jtp?type=node&node=4857796&i=0>>
> wrote:
>
> > Hi Oliver,
> >
> > I have a small () question for you -
> >
> > I am running some tests and presenting the aggregate report - in this,
> > Average Response Time, which is the second column in agg. report table is
>
> > the "average of set of response times", but the the value displayed in
> the
> > last row - Total - and under Average column is not matching up when i do
> > the
> > average of response times manually.
> >
> > For ex, have a look at the below table: I have taken Average in seconds.
> > The
> > Average *0.66* in the last row is not matching up when i do the average
> of
> > the response time manually. Also, Min and Max represent the min. response
>
> > time and max. response time for that particular label (navigation) -
> right
> > ?
> >
> >
> > *Label*
> >
> > *Samples*
> >
> > *Average (s)*
> >
> > *Median*
> >
> > *90%Line*
> >
> > *Min*
> >
> > *Max*
> >
> > *Error%*
> >
> > *Throughput*
> >
> > *KB/Sec*
> >
> > URL
> >
> > 75
> >
> > 1.00
> >
> > 749
> >
> > 3019
> >
> > 27
> >
> > 6035
> >
> > 0
> >
> > 8.39
> >
> > 164.26
> >
> > 1
> >
> > 50
> >
> > 0.63
> >
> > 34
> >
> > 2978
> >
> > 20
> >
> > 6031
> >
> > 0
> >
> > 7.38
> >
> > 53.07
> >
> > Login Page
> >
> > 25
> >
> > 0.14
> >
> > 17
> >
> > 33
> >
> > 12
> >
> > 3009
> >
> > 0
> >
> > 3.74
> >
> > 25.02
> >
> > 2
> >
> > 25
> >
> > 0.13
> >
> > 9
> >
> > 16
> >
> > 7
> >
> > 2939
> >
> > 0
> >
> > 3.74
> >
> > 5.69
> >
> > 3
> >
> > 25
> >
> > 1.10
> >
> > 864
> >
> > 1120
> >
> > 306
> >
> > 4106
> >
> > 0
> >
> > 3.36
> >
> > 146.53
> >
> > 4 Home Page
> >
> > 25
> >
> > 0.87
> >
> > 957
> >
> > 1028
> >
> > 234
> >
> > 1038
> >
> > 0
> >
> > 2.78
> >
> > 121.36
> >
> > 5
> >
> > 25
> >
> > 0.05
> >
> > 52
> >
> > 59
> >
> > 30
> >
> > 77
> >
> > 0
> >
> > 2.86
> >
> > 7.46
> >
> > *TOTAL*
> >
> > *250*
> >
> > *0.66*
> >
> > *58*
> >
> > *2961*
> >
> > *7*
> >
> > *6035*
> >
> > *0*
> >
> > *24.94*
> >
> > *427.27*
> >
> >
> > Please clear my doubts.
> >
> > Thanks,
> > Sd
> >
> >
> > On Sat, Aug 20, 2011 at 5:11 PM, Oliver Lloyd [via JMeter] <
> > [hidden email] <http://user/SendEmail.jtp?type=node&node=4857796&i=1>>
> wrote:
> >
> > > The problem here is you are trying to do something that is essentially
> > not
> > > possible and, crucially, not useful.
> > >
> > > JMeter is not a browser so it will never give you the exact same
> response
> > > times for rendering a page as you see in your browser. Indeed,
> different
> > > browsers themselves will give you different page load times so there's
> > > really no point worrying about the difference.
> > >
> > > What you really need to do is work out your objectives - what are you
> > > trying to do? What are your requirements for testing? You should
> qualify
> > in
> > > verbal terms what you what to achieve and then prove the same using
> your
> > > tests. Then you should quantify these statements to create actual
> targets
> > to
> > > aim for, giving you pass / fail criteria. Having objectives is
> especially
> > > important when thinking about 'rendering' the full page because this
> > > experience is effected by multiple things and needs to be understood
> and
> > > planned for. For example, do you even want to simulate page resources?
> > Are
> > > you using a CDN? Are there any other types of caches that you need to
> > take
> > > account of when designing your load?
> > >
> > > Based on the requirements you then go away and design a test that meets
>
> > > them. If page rendering is in scope, if you want to validate the client
>
> > side
> > > performance, then this is more of a functional activity - you cannot
> use
> > a
> > > tool like JMeter to test this. In fact you don't need a 'tool' to do
> this
> > at
> > > all, just a mouse and keyboard will suffice. Client side performance is
>
> > > crucial - there are lots of things to be considered and tuned for - but
>
> > it
> > > is not really relevant in this forum.
> > >
> > > So, in short, page load times and server response are part of the same
> > user
> > > experience but need to be approached in different manners - this is an
> > age
> > > old principle of performance testing which is routinely misunderstood.
> > >
> > > If you can't get your head around this then these days you can solve
> the
> > > problem by paying an external company to run tests where each script
> runs
> > in
> > > it's own browser (the Cloud makes this possible) or you can go down the
>
> > > hybrid path and use another (rather well known) load test tool that
> gives
> > > you GUI like scripts that almost run full browsers. If you don't have
> the
> > > budget for this then JMeter offers an excellent solution, however
> without
> > a
> > > basic foundation knowledge of computing you're very unlikely to do a
> good
> > > job.
> > >
> > > ------------------------------
> > > If you reply to this email, your message will be added to the
> discussion
> > > below:
> > >
> > >
> >
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
> > > To unsubscribe from If i do a manual execution by adding extended
> status
> > > bar to firefox, click here<
> >
> >.
> > >
> > >
> >
> >
> > --
> > View this message in context:
> >
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4856044.html
>
> > Sent from the JMeter - User mailing list archive at Nabble.com.
> >
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4857796.html
> To unsubscribe from If i do a manual execution by adding extended status
> bar to firefox, click here<http://jmeter.512774.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4717698&code=c3ByYXNhZC5zYWR1QGdtYWlsLmNvbXw0NzE3Njk4fC0xNDM4OTcyNzI4>.
>
>
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4859100.html
Sent from the JMeter - User mailing list archive at Nabble.com.
Re: If i do a manual execution by adding extended status bar to firefox
Posted by Deepak Shetty <sh...@gmail.com>.
how have you calculated it manually (the last row value is not much useful
anyway)?
If Request1 = 10 samples each 10 secs therefore avg =10 seconds
and request2 = 1 sample , 1 second therefore avg = 1 second
then overall average = (10*10 + 1*1)seconds/(10+1) samples.
regards
deepak
On Thu, Sep 29, 2011 at 11:50 PM, sprasad <sp...@gmail.com> wrote:
> Hi Oliver,
>
> I have a small () question for you -
>
> I am running some tests and presenting the aggregate report - in this,
> Average Response Time, which is the second column in agg. report table is
> the "average of set of response times", but the the value displayed in the
> last row - Total - and under Average column is not matching up when i do
> the
> average of response times manually.
>
> For ex, have a look at the below table: I have taken Average in seconds.
> The
> Average *0.66* in the last row is not matching up when i do the average of
> the response time manually. Also, Min and Max represent the min. response
> time and max. response time for that particular label (navigation) - right
> ?
>
>
> *Label*
>
> *Samples*
>
> *Average (s)*
>
> *Median*
>
> *90%Line*
>
> *Min*
>
> *Max*
>
> *Error%*
>
> *Throughput*
>
> *KB/Sec*
>
> URL
>
> 75
>
> 1.00
>
> 749
>
> 3019
>
> 27
>
> 6035
>
> 0
>
> 8.39
>
> 164.26
>
> 1
>
> 50
>
> 0.63
>
> 34
>
> 2978
>
> 20
>
> 6031
>
> 0
>
> 7.38
>
> 53.07
>
> Login Page
>
> 25
>
> 0.14
>
> 17
>
> 33
>
> 12
>
> 3009
>
> 0
>
> 3.74
>
> 25.02
>
> 2
>
> 25
>
> 0.13
>
> 9
>
> 16
>
> 7
>
> 2939
>
> 0
>
> 3.74
>
> 5.69
>
> 3
>
> 25
>
> 1.10
>
> 864
>
> 1120
>
> 306
>
> 4106
>
> 0
>
> 3.36
>
> 146.53
>
> 4 Home Page
>
> 25
>
> 0.87
>
> 957
>
> 1028
>
> 234
>
> 1038
>
> 0
>
> 2.78
>
> 121.36
>
> 5
>
> 25
>
> 0.05
>
> 52
>
> 59
>
> 30
>
> 77
>
> 0
>
> 2.86
>
> 7.46
>
> *TOTAL*
>
> *250*
>
> *0.66*
>
> *58*
>
> *2961*
>
> *7*
>
> *6035*
>
> *0*
>
> *24.94*
>
> *427.27*
>
>
> Please clear my doubts.
>
> Thanks,
> Sd
>
>
> On Sat, Aug 20, 2011 at 5:11 PM, Oliver Lloyd [via JMeter] <
> ml-node+4718262-1402807349-230167@n5.nabble.com> wrote:
>
> > The problem here is you are trying to do something that is essentially
> not
> > possible and, crucially, not useful.
> >
> > JMeter is not a browser so it will never give you the exact same response
> > times for rendering a page as you see in your browser. Indeed, different
> > browsers themselves will give you different page load times so there's
> > really no point worrying about the difference.
> >
> > What you really need to do is work out your objectives - what are you
> > trying to do? What are your requirements for testing? You should qualify
> in
> > verbal terms what you what to achieve and then prove the same using your
> > tests. Then you should quantify these statements to create actual targets
> to
> > aim for, giving you pass / fail criteria. Having objectives is especially
> > important when thinking about 'rendering' the full page because this
> > experience is effected by multiple things and needs to be understood and
> > planned for. For example, do you even want to simulate page resources?
> Are
> > you using a CDN? Are there any other types of caches that you need to
> take
> > account of when designing your load?
> >
> > Based on the requirements you then go away and design a test that meets
> > them. If page rendering is in scope, if you want to validate the client
> side
> > performance, then this is more of a functional activity - you cannot use
> a
> > tool like JMeter to test this. In fact you don't need a 'tool' to do this
> at
> > all, just a mouse and keyboard will suffice. Client side performance is
> > crucial - there are lots of things to be considered and tuned for - but
> it
> > is not really relevant in this forum.
> >
> > So, in short, page load times and server response are part of the same
> user
> > experience but need to be approached in different manners - this is an
> age
> > old principle of performance testing which is routinely misunderstood.
> >
> > If you can't get your head around this then these days you can solve the
> > problem by paying an external company to run tests where each script runs
> in
> > it's own browser (the Cloud makes this possible) or you can go down the
> > hybrid path and use another (rather well known) load test tool that gives
> > you GUI like scripts that almost run full browsers. If you don't have the
> > budget for this then JMeter offers an excellent solution, however without
> a
> > basic foundation knowledge of computing you're very unlikely to do a good
> > job.
> >
> > ------------------------------
> > If you reply to this email, your message will be added to the discussion
> > below:
> >
> >
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
> > To unsubscribe from If i do a manual execution by adding extended status
> > bar to firefox, click here<
> http://jmeter.512774.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4717698&code=c3ByYXNhZC5zYWR1QGdtYWlsLmNvbXw0NzE3Njk4fC0xNDM4OTcyNzI4
> >.
> >
> >
>
>
> --
> View this message in context:
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4856044.html
> Sent from the JMeter - User mailing list archive at Nabble.com.
>
Re: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
Hi Oliver,
I have a small () question for you -
I am running some tests and presenting the aggregate report - in this,
Average Response Time, which is the second column in agg. report table is
the "average of set of response times", but the the value displayed in the
last row - Total - and under Average column is not matching up when i do the
average of response times manually.
For ex, have a look at the below table: I have taken Average in seconds. The
Average *0.66* in the last row is not matching up when i do the average of
the response time manually. Also, Min and Max represent the min. response
time and max. response time for that particular label (navigation) - right ?
*Label*
*Samples*
*Average (s)*
*Median*
*90%Line*
*Min*
*Max*
*Error%*
*Throughput*
*KB/Sec*
URL
75
1.00
749
3019
27
6035
0
8.39
164.26
1
50
0.63
34
2978
20
6031
0
7.38
53.07
Login Page
25
0.14
17
33
12
3009
0
3.74
25.02
2
25
0.13
9
16
7
2939
0
3.74
5.69
3
25
1.10
864
1120
306
4106
0
3.36
146.53
4 Home Page
25
0.87
957
1028
234
1038
0
2.78
121.36
5
25
0.05
52
59
30
77
0
2.86
7.46
*TOTAL*
*250*
*0.66*
*58*
*2961*
*7*
*6035*
*0*
*24.94*
*427.27*
Please clear my doubts.
Thanks,
Sd
On Sat, Aug 20, 2011 at 5:11 PM, Oliver Lloyd [via JMeter] <
ml-node+4718262-1402807349-230167@n5.nabble.com> wrote:
> The problem here is you are trying to do something that is essentially not
> possible and, crucially, not useful.
>
> JMeter is not a browser so it will never give you the exact same response
> times for rendering a page as you see in your browser. Indeed, different
> browsers themselves will give you different page load times so there's
> really no point worrying about the difference.
>
> What you really need to do is work out your objectives - what are you
> trying to do? What are your requirements for testing? You should qualify in
> verbal terms what you what to achieve and then prove the same using your
> tests. Then you should quantify these statements to create actual targets to
> aim for, giving you pass / fail criteria. Having objectives is especially
> important when thinking about 'rendering' the full page because this
> experience is effected by multiple things and needs to be understood and
> planned for. For example, do you even want to simulate page resources? Are
> you using a CDN? Are there any other types of caches that you need to take
> account of when designing your load?
>
> Based on the requirements you then go away and design a test that meets
> them. If page rendering is in scope, if you want to validate the client side
> performance, then this is more of a functional activity - you cannot use a
> tool like JMeter to test this. In fact you don't need a 'tool' to do this at
> all, just a mouse and keyboard will suffice. Client side performance is
> crucial - there are lots of things to be considered and tuned for - but it
> is not really relevant in this forum.
>
> So, in short, page load times and server response are part of the same user
> experience but need to be approached in different manners - this is an age
> old principle of performance testing which is routinely misunderstood.
>
> If you can't get your head around this then these days you can solve the
> problem by paying an external company to run tests where each script runs in
> it's own browser (the Cloud makes this possible) or you can go down the
> hybrid path and use another (rather well known) load test tool that gives
> you GUI like scripts that almost run full browsers. If you don't have the
> budget for this then JMeter offers an excellent solution, however without a
> basic foundation knowledge of computing you're very unlikely to do a good
> job.
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
> To unsubscribe from If i do a manual execution by adding extended status
> bar to firefox, click here<http://jmeter.512774.n5.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4717698&code=c3ByYXNhZC5zYWR1QGdtYWlsLmNvbXw0NzE3Njk4fC0xNDM4OTcyNzI4>.
>
>
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4856044.html
Sent from the JMeter - User mailing list archive at Nabble.com.
RE: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
Thanks for the detailed explanation Oliver - i really appreciate it. Things
mentioned in your mail are like very valuable information for me.
This Forum is a great thing that can happen to people using JMeter.
Thank you,
Sd
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4722165.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
RE: If i do a manual execution by adding extended status bar to
firefox
Posted by Oliver Lloyd <ol...@hotmail.com>.
The problem here is you are trying to do something that is essentially not
possible and, crucially, not useful.
JMeter is not a browser so it will never give you the exact same response
times for rendering a page as you see in your browser. Indeed, different
browsers themselves will give you different page load times so there's
really no point worrying about the difference.
What you really need to do is work out your objectives - what are you trying
to do? What are your requirements for testing? You should qualify in verbal
terms what you what to achieve and then prove the same using your tests.
Then you should quantify these statements to create actual targets to aim
for, giving you pass / fail criteria. Having objectives is especially
important when thinking about 'rendering' the full page because this
experience is effected by multiple things and needs to be understood and
planned for. For example, do you even want to simulate page resources? Are
you using a CDN? Are there any other types of caches that you need to take
account of when designing your load?
Based on the requirements you then go away and design a test that meets
them. If page rendering is in scope, if you want to validate the client side
performance, then this is more of a functional activity - you cannot use a
tool like JMeter to test this. In fact you don't need a 'tool' to do this at
all, just a mouse and keyboard will suffice. Client side performance is
crucial - there are lots of things to be considered and tuned for - but it
is not really relevant in this forum.
So, in short, page load times and server response are part of the same user
experience but need to be approached in different manners - this is an age
old principle of performance testing which is routinely misunderstood.
If you can't get your head around this then these days you can solve the
problem by paying an external company to run tests where each script runs in
it's own browser (the Cloud makes this possible) or you can go down the
hybrid path and use another (rather well known) load test tool that gives
you GUI like scripts that almost run full browsers. If you don't have the
budget for this then JMeter offers an excellent solution, however without a
basic foundation knowledge of computing you're very unlikely to do a good
job.
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4718262.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
RE: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
Hi A,
I understood what you are saying and yes i am parsing the entire page and it
makes around 10 to 15 ajax calls to generate that web page. I have a page
where on executing the nodes are about 15 to 20 under the thread group just
to display that web page, i will add it up - but how can i do that as i run
the script for multiple users like 50 or 100. Also, I look the statistical
aggregate report table where it gives the average for n number of users -
which happens to be within limits and it passes the SLA, but clearly it
should be failed.
Thanks,
Sd
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4717888.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
RE: If i do a manual execution by adding extended status bar to
firefox
Posted by "Marentis, Andrew" <an...@hp.com>.
That would depend on whether you are parsing the entire page and not just the main page request, some web pages can make 20 to 30 calls back to the server (images, java script files and .css files) to display just one web page. If you are going to simulate actual user traffic then you would need to make all the requests that the browser makes when parsing a full page. You would also need to know which files are cached by the browser for each page request. Add up the time it takes for all the requests for that page to get the full page load time. That should give you a closer time to what you are seeing in your browser.
I hope that answered your question.
-A
-----Original Message-----
From: sprasad [mailto:sprasad.sadu@gmail.com]
Sent: Friday, August 19, 2011 9:41 PM
To: jmeter-user@jakarta.apache.org
Subject: If i do a manual execution by adding extended status bar to firefox
Hi,
If i do a manual execution by adding extended status bar to firefox the
response time i am getting is much higher for one user, but when i run the
same navigation(s) through JMeter script its giving a very less value and
moreover it is run for multiple users.
How one should be interpreting this?
Thanks,
Sd.
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4717698.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: If i do a manual execution by adding extended status bar to
firefox
Posted by sprasad <sp...@gmail.com>.
Hi Bruce,
It has heavy ajax this i can say for sure and also quite a number of images.
You said to use extra HTTP Request, you mean I have to just add another http
request default before the thread via config element or anything in
particular ?
Also, if it is due to java script how to compute that constant execution
time ? where can i find this one.
Please let me know on both counts.
Thanks,
Sd.
--
View this message in context: http://jmeter.512774.n5.nabble.com/If-i-do-a-manual-execution-by-adding-extended-status-bar-to-firefox-tp4717698p4717829.html
Sent from the JMeter - User mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org
Re: If i do a manual execution by adding extended status bar to firefox
Posted by Bruce Ide <fl...@gmail.com>.
If the page you're getting has a lot of graphics or runs some heavy
javascript, that might explain the difference in the numbers. If it's
graphics heavy, I believe you need to create extra http requests to get the
images. That should give you a total number similar to the browser. If it's
due to Javascript you'll just have to compute a constant execution time
that's added by the Javascript. If this is the case you'll probably want to
compute different ones for each browser, too, since Chrome handles
Javascript a lot faster than Firefox does.
--
Bruce Ide
FlyingRhenquest@gmail.com