Performance Testing?

[Roy Wood <ro...@filogix.com>]

Anyone here have suggestions as to generating some semi-relevant 
performance numbers for a SOAP service?  

Any recommended tools out there, or should I just roll my own?

All I'm looking for is some rough idea as to what sort of client 
transaction load my app/server can support.


-Roy

Re: Performance Testing?

[Benjamin Tomasini <bt...@neteverything.com>]

I have been rolling my own test samplers for JMeter.  It seems to work
ok, but I have come across one issue.

I am working with some pretty complex BeanSerialization.  On the load
tests, the server's cpu sits at around 20%, but the client cpu is often
pegged.  I think it has to do with the fact that I am registering all of
the types on the client side and having the call fully deserialize the
object.

For the load testing, I don't need to deserialize the request. Is there
a way to make an Axis call return null or do nothing more than confirm
that there wasn't a fault?

I say the invokeOneWay(), but saw that one day it would return
immediatly.  I need for the method to block until the server is done. 
Otherwise I can't time the request, and I can't really load the server
without creating a virual DoS.

Any thoughts?

Ben Tomasini

On Fri, 2002-11-29 at 12:30, Roy Wood wrote:
> Anyone here have suggestions as to generating some semi-relevant 
> performance numbers for a SOAP service?  
> 
> Any recommended tools out there, or should I just roll my own?
> 
> All I'm looking for is some rough idea as to what sort of client 
> transaction load my app/server can support.
> 
> 
> -Roy

Re: Performance Testing?

[Steve Loughran <st...@iseran.com>]

When I was doing load testing we

-wrote a client to simulate the real client as much as possible, with delays
and things where appropriate client side

-had the main() routine take #threads and #iterations as params, among
others

-output the results in basic CSV format, with the timestamp of each call at
the beginning

-<java> invoked this in an ant build file that slowly ramped up the load:
1-5-10-20-30-50-100 threads, same 1000 iterations

-set this build file up to run on 5 different machines over night, all with
clocks in sync

in the am we'd come in and get the CSV files, merge them, strip out the lead
in and lead out of each iteration and then work out the average round trip
time under the different loads, which was then xformed into a graph of
response time vs load, showing where we came in under the 2s limit the SLA
demanded.

It all worked well, but proper tools might be nice too. There is something
in jakarta for this; The book Extreme Programming in Java with open source
tools (hightower and liesieki) cover it.

One thing we added early on was server side logging of the interval between
aspects of the service: parse and sanitise, external URL fetch, render, save
file, and returned these with the rest of the result. So you not only see
how long things took, but identify issues. If external url fetching was
slow, it meant the net connections in the cluster were off, for example. A
bit of a breakdown is invaluable. You could do this in Axis with handlers.

-steve

----- Original Message -----
From: "Roy Wood" <ro...@filogix.com>
To: <ax...@xml.apache.org>
Sent: Friday, November 29, 2002 12:30
Subject: Performance Testing?


> Anyone here have suggestions as to generating some semi-relevant
> performance numbers for a SOAP service?
>
> Any recommended tools out there, or should I just roll my own?
>
> All I'm looking for is some rough idea as to what sort of client
> transaction load my app/server can support.
>
>
> -Roy
>

Re: Test Web services?

[michel <co...@videotron.ca>]

----- Original Message -----
From: "Trond Hjelmaas" <th...@cse.unsw.EDU.AU>
To: <ax...@xml.apache.org>
Sent: Friday, November 29, 2002 10:29 PM
Subject: Re: Test Web services?


>
> try www.xmethods.com some of them are not simple so you have to look for a
> simple one.
>
> If you need a program to invoke services, try www.mindelectric.com (GLUE)
>


Trond,

Much appreciate! I just got my system working! Wouhou!!!


Regards,


Michael

Re: Test Web services?

[Trond Hjelmaas <th...@cse.unsw.EDU.AU>]

try www.xmethods.com some of them are not simple so you have to look for a
simple one.

If you need a program to invoke services, try www.mindelectric.com (GLUE)

/Trond

On Fri, 29 Nov 2002, michel wrote:

> Hi,
>
> I'm using JBuilder 7 for SOAP development, and I'm getting weird results
> even connecting to services on my own local server. Are there any simple
> test services available on the net, like "hello world"?
>
> Thanks!
>

Test Web services?

[michel <co...@videotron.ca>]

Hi,

I'm using JBuilder 7 for SOAP development, and I'm getting weird results
even connecting to services on my own local server. Are there any simple
test services available on the net, like "hello world"?

Thanks!