Am I on the right track?

[h b <hb...@gmail.com>]

Hello, I'm new to JMeter.  I was wondering if you could share some of your
experiences with me.



I'm testing a web application, I want to know how scalable the app is and
how well it performs.



setup: The server & the jmeter-machine are seperate machines.



I have set up a test, then I ramp up the number of threads.  I started with
10 threads 50 requests and worked my way up to 100 threads 50 requests.
ramp up period of 1 second for all test cases.  Then I look at the result
using the Aggregate Report and Graph Result listeners.



During the ramp-up what I'm seeing is that the throughput increases to 17
requests per second and then tapers off.  I'm guessing that this is a good
measure of the scalability of the application.  Is that correct?



The other numbers that I find interesting are the median response time
(+deviation) and the 90% line:  These numbers increase as the number of
threads increase.  My understanding is that when I'm running the case 50
threads, 50 requests what's happening is that for most of the duration of
the test the server is loaded with 50 requests.  So the median response time
of X seems to suggest, that when the server is loaded with 50 requests the
average response time is X.  Is this correct?


The application that I'm testing needs to respond in less than 2 seconds
when it is processing 50-100 requests.  Am I on the right track with my test
setup and am I understanding the results correctly?


Thanks in advance.

Re: Am I on the right track?

[sebb <se...@gmail.com>]

On 28/01/2008, h b <hb...@gmail.com> wrote:
> Hello, I'm new to JMeter.  I was wondering if you could share some of your
> experiences with me.
>
>
>
> I'm testing a web application, I want to know how scalable the app is and
> how well it performs.
>
>
>
> setup: The server & the jmeter-machine are seperate machines.
>

Good, but ensure that the network is no worse than will be used when
the service is live.

>
> I have set up a test, then I ramp up the number of threads.  I started with
> 10 threads 50 requests and worked my way up to 100 threads 50 requests.
> ramp up period of 1 second for all test cases.

Ramp-up should be increased for 100 threads, e.g. to 10 or 20, perhaps more.

How many loops?
It's important to run the test for long enough to reach a steady state.

> Then I look at the result using the Aggregate Report and Graph Result listeners.

Summary Report is cheaper if you are doing live monitoring.

>
>
> During the ramp-up what I'm seeing is that the throughput increases to 17
> requests per second and then tapers off.  I'm guessing that this is a good
> measure of the scalability of the application.  Is that correct?
>

Most likely.

>
>
> The other numbers that I find interesting are the median response time
> (+deviation) and the 90% line:  These numbers increase as the number of
> threads increase.  My understanding is that when I'm running the case 50
> threads, 50 requests what's happening is that for most of the duration of
> the test the server is loaded with 50 requests.  So the median response time
> of X seems to suggest, that when the server is loaded with 50 requests the
> average response time is X.  Is this correct?

Yes.

>
> The application that I'm testing needs to respond in less than 2 seconds
> when it is processing 50-100 requests.  Am I on the right track with my test
> setup and am I understanding the results correctly?
>

Yes, it seems like it.

Remember that 50 simultaneous requests represents a lot more than 50
users, once you take think-time into account.

>
> Thanks in advance.
>

---------------------------------------------------------------------
To unsubscribe, e-mail: jmeter-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: jmeter-user-help@jakarta.apache.org