Fault on heavy load

[Frank Cohen <fc...@pushtotest.com>]

I know Axis is just in beta but I wondered what Axis' scalability and 
performance looks like. With Sun's support I installed Axis b2 and 
Tomcat 4.0.3 on a Sun E4500 server with 6 CPUs, 4 G RAM, Sun Java 1.4 
and Solaris 9. I used TestMaker (http://www.PushToTest.com) to create 
SOAP RPC and SOAP document-style calls to a simple Test Web Service 
(TWS.) TWS responds with random gibberish in a String element. The size 
of the gibberish ranged in bytes: 600, 3000, 9000, 24000, 57000, 96000. 
TestMaker uses Apache SOAP 2.3.1 on the client side. I had TestMaker 
create 100 concurrently running threads, each thread makes a SOAP 
request, waits for the response, then repeats. I ran the 100 threads 
for 1 minute after all the threads were instantiated and running. Below 
are the results I received.

Axis began throwing fault responses almost immediately. Below is the 
log extract showing the exception. 

I'm not really sure where to go from here, if anywhere. I'm all ears to 
suggestions and ideas on testing Axis for scalability, now and when 
it's ready for some real testing.

-Frank

---

Agent count: 100
Payload size: 100
Transactions completed: 10128
Transactions per second: 168.8
Recording time: 60528
21 errors


Agent count: 100
Payload size: 500
Transactions completed: 9016
Transactions per second: 150.26666666666668
Recording time: 60186
Errors: 315

Agent count: 100
Payload size: 1500
Transactions completed: 6654
Transactions per second: 110.9
Recording time: 60289
Errors: 868


Agent count: 100
Payload size: 4000
Transactions completed: 4358
Transactions per second: 72.63333333333334
Recording time: 60003
Errors: 1354


Agent count: 100
Payload size: 9500
Transactions completed: 1433
Transactions per second: 23.883333333333333
Recording time: 60209
Errors: 231


Agent count: 100
Payload size: 16000
Transactions completed: 1468
Transactions per second: 24.466666666666665
Recording time: 60035
Errors: 1002


---

except from catalina.out:

- Exception:
java.lang.IllegalArgumentException
	at org.apache.axis.AxisFault.makeFault(AxisFault.java:116)
	at org.apache.axis.providers.java.JavaProvider.invoke
(JavaProvider.java:267)
	at org.apache.axis.strategies.InvocationStrategy.visit
(InvocationStrategy.java:71)
	at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:154)
	at org.apache.axis.SimpleChain.invoke(SimpleChain.java:121)
	at org.apache.axis.server.AxisServer.invoke(AxisServer.java:288)
	at org.apache.axis.transport.http.AxisServlet.doPost
(AxisServlet.java:576)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
	at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter
(ApplicationFilterChain.java:247)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter
(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.StandardWrapperValve.invoke
(StandardWrapperValve.java:243)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:566)
	at org.apache.catalina.core.StandardPipeline.invoke
(StandardPipeline.java:472)
	at org.apache.catalina.core.ContainerBase.invoke
(ContainerBase.java:943)
	at org.apache.catalina.core.StandardContextValve.invoke
(StandardContextValve.java:190)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:566)
	at org.apache.catalina.valves.CertificatesValve.invoke
(CertificatesValve.java:246)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:564)
	at org.apache.catalina.core.StandardPipeline.invoke
(StandardPipeline.java:472)
	at org.apache.catalina.core.ContainerBase.invoke
(ContainerBase.java:943)
	at org.apache.catalina.core.StandardContext.invoke
(StandardContext.java:2343)
	at org.apache.catalina.core.StandardHostValve.invoke
(StandardHostValve.java:180)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:566)
	at org.apache.catalina.valves.ErrorDispatcherValve.invoke
(ErrorDispatcherValve.java:170)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:564)
	at org.apache.catalina.valves.ErrorReportValve.invoke
(ErrorReportValve.java:170)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:564)
	at org.apache.catalina.valves.AccessLogValve.invoke
(AccessLogValve.java:468)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:564)
	at org.apache.catalina.core.StandardPipeline.invoke
(StandardPipeline.java:472)
	at org.apache.catalina.core.ContainerBase.invoke
(ContainerBase.java:943)
	at org.apache.catalina.core.StandardEngineValve.invoke
(StandardEngineValve.java:174)
	at org.apache.catalina.core.StandardPipeline.invokeNext
(StandardPipeline.java:566)
	at org.apache.catalina.core.StandardPipeline.invoke
(StandardPipeline.java:472)
	at org.apache.catalina.core.ContainerBase.invoke
(ContainerBase.java:943)
	at org.apache.catalina.connector.http.HttpProcessor.process
(HttpProcessor.java:1012)
	at org.apache.catalina.connector.http.HttpProcessor.run
(HttpProcessor.java:1107)
	at java.lang.Thread.run(Thread.java:536)
Caused by: java.lang.IllegalArgumentException
	at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:324)
	at org.apache.axis.providers.java.RPCProvider.processMessage
(RPCProvider.java:229)
	at org.apache.axis.providers.java.JavaProvider.invoke
(JavaProvider.java:262)
	... 37 more


--
http://www.PushToTest.com for free testing tools for testing Web 
Services