You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Peter Lin <wo...@gmail.com> on 2005/02/12 06:20:10 UTC

Tomcat vs Jetty

For those who are curious. I decided to run apache AB against jetty to
see if there are any differences.

Max Request/sec
------------------------------
tomcat 5.5.4 - 5584
jetty 5.1.2 - 2486


the results suggest tomcat's throughput for 1k static content is 2x
higher than the jetty 5.1.2.

peter


The setup
--------------------------------------
Server:
amd 2ghz
1gb of ram
Redhat Fedora Core 1

tomcat 5.5.4 + jdk5
jetty 5.1.2 + jdk5


Client:
gateway 450 laptop
1.4ghz centrino Pentium M
1gb ram
apache2 ab


C:\Apache\Apache2\bin>ab -n 50000 -c 50 -k
http://192.168.0.41:8080/benchmark/1k.png
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.121.2.12 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.168.0.41 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests


Server Software:        Jetty/5.1.2
Server Hostname:        192.168.0.41
Server Port:            8080

Document Path:          /benchmark/1k.png
Document Length:        1056 bytes

Concurrency Level:      50
Time taken for tests:   20.469434 seconds
Complete requests:      50000
Failed requests:        0
Write errors:           0
Keep-Alive requests:    50000
Total transferred:      65850000 bytes
HTML transferred:       52800000 bytes
Requests per second:    2442.67 [#/sec] (mean)
Time per request:       20.469 [ms] (mean)
Time per request:       0.409 [ms] (mean, across all concurrent requests)
Transfer rate:          3141.56 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0      10
Processing:     0   20  50.3     10    2373
Waiting:        0   20  50.3     10    2373
Total:          0   20  50.3     10    2373

Percentage of the requests served within a certain time (ms)
  50%     10
  66%     10
  75%     10
  80%     10
  90%     70
  95%    110
  98%    190
  99%    240
 100%   2373 (longest request)
 
C:\Apache\Apache2\bin>ab -n 50000 -c 50 -k
http://192.168.0.41:8080/benchmark/1k.png
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.121.2.12 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.168.0.41 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests


Server Software:        Jetty/5.1.2
Server Hostname:        192.168.0.41
Server Port:            8080

Document Path:          /benchmark/1k.png
Document Length:        1056 bytes

Concurrency Level:      50
Time taken for tests:   20.829952 seconds
Complete requests:      50000
Failed requests:        0
Write errors:           0
Keep-Alive requests:    50000
Total transferred:      65850000 bytes
HTML transferred:       52800000 bytes
Requests per second:    2400.39 [#/sec] (mean)
Time per request:       20.830 [ms] (mean)
Time per request:       0.417 [ms] (mean, across all concurrent requests)
Transfer rate:          3087.19 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0      10
Processing:     0   20  67.4     10    3855
Waiting:        0   20  67.4     10    3855
Total:          0   20  67.4     10    3855

Percentage of the requests served within a certain time (ms)
  50%     10
  66%     10
  75%     10
  80%     10
  90%     60
  95%    110
  98%    190
  99%    250
 100%   3855 (longest request) 
 
 C:\Apache\Apache2\bin>ab -n 50000 -c 50 -k
http://192.168.0.41:8080/benchmark/1k.png
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.121.2.12 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.168.0.41 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests


Server Software:        Jetty/5.1.2
Server Hostname:        192.168.0.41
Server Port:            8080

Document Path:          /benchmark/1k.png
Document Length:        1056 bytes

Concurrency Level:      50
Time taken for tests:   20.108915 seconds
Complete requests:      50000
Failed requests:        0
Write errors:           0
Keep-Alive requests:    50000
Total transferred:      65850000 bytes
HTML transferred:       52800000 bytes
Requests per second:    2486.46 [#/sec] (mean)
Time per request:       20.109 [ms] (mean)
Time per request:       0.402 [ms] (mean, across all concurrent requests)
Transfer rate:          3197.89 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0      10
Processing:     0   17 118.3      0    8251
Waiting:        0   17 118.3      0    8251
Total:          0   17 118.4      0    8251

Percentage of the requests served within a certain time (ms)
  50%      0
  66%     10
  75%     10
  80%     10
  90%     10
  95%     50
  98%    190
  99%    300
 100%   8251 (longest request)
 
C:\Apache\Apache2\bin>ab -n 50000 -c 50 -k
http://192.168.0.41:8080/benchmark/1k.png
This is ApacheBench, Version 2.0.41-dev <$Revision: 1.121.2.12 $> apache-2.0
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2002 The Apache Software Foundation, http://www.apache.org/

Benchmarking 192.168.0.41 (be patient)
Completed 5000 requests
Completed 10000 requests
Completed 15000 requests
Completed 20000 requests
Completed 25000 requests
Completed 30000 requests
Completed 35000 requests
Completed 40000 requests
Completed 45000 requests
Finished 50000 requests


Server Software:        Jetty/5.1.2
Server Hostname:        192.168.0.41
Server Port:            8080

Document Path:          /benchmark/1k.png
Document Length:        1056 bytes

Concurrency Level:      50
Time taken for tests:   20.359275 seconds
Complete requests:      50000
Failed requests:        0
Write errors:           0
Keep-Alive requests:    50000
Total transferred:      65850000 bytes
HTML transferred:       52800000 bytes
Requests per second:    2455.88 [#/sec] (mean)
Time per request:       20.359 [ms] (mean)
Time per request:       0.407 [ms] (mean, across all concurrent requests)
Transfer rate:          3158.56 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.1      0      10
Processing:     0   19 127.4      0    6259
Waiting:        0   19 127.4      0    6259
Total:          0   19 127.4      0    6259

Percentage of the requests served within a certain time (ms)
  50%      0
  66%     10
  75%     10
  80%     10
  90%     10
  95%     50
  98%    200
  99%    310
 100%   6259 (longest request)

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org


Re: Tomcat vs Jetty

Posted by Joe <li...@concrete-it.com>.
Peter Lin wrote:

>For those who are curious. I decided to run apache AB against jetty to
>see if there are any differences.
>
>Max Request/sec
>------------------------------
>tomcat 5.5.4 - 5584
>jetty 5.1.2 - 2486
>
>
>the results suggest tomcat's throughput for 1k static content is 2x
>higher than the jetty 5.1.2.
>
>peter
>  
>
looks quite nice!
have you tried resin on the same machine too?

greetings,
joe

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org


Re: Tomcat vs Jetty

Posted by Peter Lin <wo...@gmail.com>.
I had a hard time understanding what those graphs mean. It really
could use better captions to really explain clearly what the X and Y
axis mean. I don't see any point comparing simple honestly, since it's
not a servlet container.

but I'm totally bias :)

peter


On Sun, 13 Feb 2005 15:53:27 +0100, Remy Maucherat
<re...@gmail.com> wrote:
> On Sat, 12 Feb 2005 10:51:53 +0100, PA <pe...@gmail.com> wrote:
> >
> > On Feb 12, 2005, at 06:20, Peter Lin wrote:
> >
> > > For those who are curious. I decided to run apache AB against jetty to
> > > see if there are any differences.
> >
> > If you are into this kind of micro-benchmarks, take a look at Simple:
> >
> > http://simpleweb.sourceforge.net/
> >
> > Niall Gallagher ran some comparisons between Apache, Resin and Tomcat:
> >
> > http://simpleweb.sourceforge.net/performance/comparison.php
> >
> > Quite instructive :P
> 
> Unless Peter does a round of benchmarking on that, I see nothing but
> misinformation.
> 
> Right now, the test is not very fair (conviniently old Tomcat version;
> not the same application code appeared to be running on both servers
> as the other one doesn't support the servlet API) and not very well
> specified either (there's text about the test, but I don't understand
> it in a way that woud allow me to reproduce the test).
> 
> --
> xxxxxxxxxxxxxxxxxxxxxxxxx
> Rémy Maucherat
> Developer & Consultant
> JBoss Group (Europe) SàRL
> xxxxxxxxxxxxxxxxxxxxxxxxx
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-user-help@jakarta.apache.org
> 
>

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org


Re: Tomcat vs Jetty

Posted by Remy Maucherat <re...@gmail.com>.
On Sat, 12 Feb 2005 10:51:53 +0100, PA <pe...@gmail.com> wrote:
> 
> On Feb 12, 2005, at 06:20, Peter Lin wrote:
> 
> > For those who are curious. I decided to run apache AB against jetty to
> > see if there are any differences.
> 
> If you are into this kind of micro-benchmarks, take a look at Simple:
> 
> http://simpleweb.sourceforge.net/
> 
> Niall Gallagher ran some comparisons between Apache, Resin and Tomcat:
> 
> http://simpleweb.sourceforge.net/performance/comparison.php
> 
> Quite instructive :P

Unless Peter does a round of benchmarking on that, I see nothing but
misinformation.

Right now, the test is not very fair (conviniently old Tomcat version;
not the same application code appeared to be running on both servers
as the other one doesn't support the servlet API) and not very well
specified either (there's text about the test, but I don't understand
it in a way that woud allow me to reproduce the test).

-- 
xxxxxxxxxxxxxxxxxxxxxxxxx
Rémy Maucherat
Developer & Consultant
JBoss Group (Europe) SàRL
xxxxxxxxxxxxxxxxxxxxxxxxx

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org


Re: Tomcat vs Jetty

Posted by PA <pe...@gmail.com>.
On Feb 12, 2005, at 06:20, Peter Lin wrote:

> For those who are curious. I decided to run apache AB against jetty to
> see if there are any differences.

If you are into this kind of micro-benchmarks, take a look at Simple:

http://simpleweb.sourceforge.net/

Niall Gallagher ran some comparisons between Apache, Resin and Tomcat:

http://simpleweb.sourceforge.net/performance/comparison.php

Quite instructive :P

Cheers

--
PA, Onnay Equitursay
http://alt.textdrive.com/


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org