You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Peter Lin <wo...@gmail.com> on 2005/01/16 19:15:01 UTC
latest set of Benchmark results
Here is the latest set of benchmark results. I discovered an error in
my test plan for 40K PNG, so the results for that one was off. All of
the other results should be accurate. I re-ran the tests.
Server:
AMD 2ghz
1Gb RAM
Redhat FedoraCore1
Client:
Gateway laptop 450
1.4ghz centrino
Windows XP pro
jdk1.4.2
jmeter nightly build
16 port Switch Linksys 10/100
CAT5 cables
All threads ran for 1000 iterations.
thread scenario: 5, 10, 15, 20, 25, 30
image/html size: 1, 10, 20, 40, 80, 160
The test includes 5.0.19 (aka 5.0), 5.5.4, apache 2.0.50, apache
1.3.3. I hope people find it interesting and useful. It will take me
a week or two to write up the results and generate the graphs.
peter lin
Tomcat 5.0.19 - jdk1.4.2
PNG
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 5.1556 0 10 0 681 0.00% 433.0/sec 446.54
HTTP Request 10000 6.5027 0 10 0 1702 0.00% 813.1/sec 838.55
HTTP Request 15000 4.83573 0 10 0 150 0.00% 1333.8/sec 1375.49
HTTP Request 20000 5.0478 0 10 0 2003 0.00% 1236.6/sec 1275.19
HTTP Request 25000 11.1284 10 30 0 260 0.00% 1258.9/sec 1298.28
HTTP Request 30000 21.2057 20 30 0 100 0.00% 1221.2/sec 1259.41
5k
----------------
HTTP Request 5000 3.3992 0 10 0 270 0.00% 894.8/sec 4552.51
HTTP Request 10000 5.5172 0 10 0 421 0.00% 973.2/sec 4951.72
HTTP Request 15000 5.47953 0 20 0 201 0.00% 891.0/sec 4533.32
HTTP Request 20000 8.15755 0 20 0 291 0.00% 929.8/sec 4730.50
HTTP Request 25000 12.5837 10 30 0 190 0.00% 921.9/sec 4690.34
HTTP Request 30000 11.5905 0 40 0 1522 0.00% 822.5/sec 4184.92
10k
----------------
HTTP Request 5000 4.4988 0 10 0 1573 0.00% 749.6/sec 7538.71
HTTP Request 10000 8.2505 10 20 0 230 0.00% 766.3/sec 7706.83
HTTP Request 15000 6.98413 0 20 0 862 0.00% 727.4/sec 7315.69
HTTP Request 20000 12.345 10 30 0 300 0.00% 710.7/sec 7147.32
HTTP Request 25000 18.6458 11 40 0 430 0.00% 696.7/sec 7006.74
HTTP Request 30000 33.4359 40 60 0 300 0.00% 680.7/sec 6845.44
20k
----------------
HTTP Request 5000 10.8294 0 10 0 3084 0.00% 259.0/sec 5231.30
HTTP Request 10000 14.9086 10 30 0 1372 0.00% 418.1/sec 8447.07
HTTP Request 15000 22.2814 20 40 0 471 0.00% 490.5/sec 9907.72
HTTP Request 20000 37.3174 40 50 0 440 0.00% 491.2/sec 9922.48
HTTP Request 25000 37.4917 40 70 0 1552 0.00% 448.0/sec 9050.54
HTTP Request 30000 43.7394 50 80 0 2393 0.00% 452.8/sec 9146.87
40k
----------------
HTTP Request 5000 16.1594 11 20 0 270 0.00% 270.2/sec 10825.45
HTTP Request 10000 32.0691 30 40 0 281 0.00% 283.8/sec 11370.09
HTTP Request 15000 49.0089 50 60 0 231 0.00% 285.1/sec 11425.53
HTTP Request 20000 62.9201 60 80 0 461 0.00% 284.7/sec 11405.85
HTTP Request 25000 76.398 80 100 0 721 0.00% 279.6/sec 11204.07
HTTP Request 30000 100.121 100 140 0 831 0.00% 272.7/sec 10927.21
80k
----------------
HTTP Request 5000 33.5142 30 40 0 310 0.00% 141.2/sec 11349.39
HTTP Request 10000 67.5162 70 80 0 280 0.00% 143.0/sec 11495.76
HTTP Request 15000 103.413 100 111 0 811 0.00% 140.1/sec 11261.33
HTTP Request 20000 141.583 130 150 0 942 0.00% 137.9/sec 11090.00
HTTP Request 25000 178.314 170 191 0 1182 0.00% 136.2/sec 10951.84
HTTP Request 30000 215.295 191 270 0 1312 0.00% 135.5/sec 10897.99
160k
----------------
HTTP Request 5000 67.4416 70 71 10 200 0.00% 71.9/sec 11509.28
HTTP Request 10000 137.940 131 141 10 901 0.00% 71.0/sec 11367.65
HTTP Request 15000 211.484 200 221 10 1082 0.00% 69.6/sec 11131.86
HTTP Request 20000 287.701 261 330 10 1492 0.00% 68.4/sec 10948.54
HTTP Request 25000 366.186 321 441 10 1753 0.00% 67.2/sec 10749.21
HTTP Request 30000 440.732 400 641 10 2023 0.00% 66.6/sec 10660.00
HTML
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 3.096 0 10 0 311 0.00% 479.2/sec 531.56
HTTP Request 10000 5.6273 0 10 0 501 0.00% 553.8/sec 614.41
HTTP Request 15000 10.6164 0 20 0 1272 0.00% 654.1/sec 725.62
HTTP Request 20000 2.58075 0 10 0 101 0.00% 1400.6/sec 1553.75
HTTP Request 25000 8.3144 0 20 0 180 0.00% 1295.5/sec 1437.16
HTTP Request 30000 6.39523 0 20 0 2714 0.00% 1296.8/sec 1438.69
5k
----------------
HTTP Request 5000 3.6674 0 10 0 430 0.00% 886.8/sec 4699.21
HTTP Request 10000 5.7022 0 10 0 311 0.00% 1006.6/sec 5334.03
HTTP Request 15000 5.4430 0 10 0 671 0.00% 993.2/sec 5263.04
HTTP Request 20000 7.82135 0 20 0 2043 0.00% 998.6/sec 5291.16
HTTP Request 25000 10.8727 10 30 0 1473 0.00% 974.4/sec 5163.14
HTTP Request 30000 9.45666 0 30 0 3535 0.00% 940.3/sec 4982.29
10k
----------------
HTTP Request 5000 4.222 0 10 0 491 0.00% 718.4/sec 7340.35
HTTP Request 10000 7.4147 0 10 0 1832 0.00% 740.8/sec 7569.28
HTTP Request 15000 9.90066 0 20 0 2243 0.00% 745.2/sec 7614.22
HTTP Request 20000 9.3756 0 30 0 531 0.00% 730.5/sec 7463.68
HTTP Request 25000 32.8860 30 50 0 621 0.00% 717.6/sec 7331.93
HTTP Request 30000 12.5344 0 40 0 1412 0.00% 711.2/sec 7267.26
20k
----------------
HTTP Request 5000 6.2684 0 10 0 901 0.00% 511.6/sec 10225.23
HTTP Request 10000 13.7287 10 20 0 831 0.00% 525.0/sec 10494.19
HTTP Request 15000 21.6525 20 40 0 371 0.00% 511.9/sec 10232.21
HTTP Request 20000 26.8041 30 50 0 1702 0.00% 489.6/sec 9786.42
HTTP Request 25000 48.5664 50 70 0 561 0.00% 490.2/sec 9797.60
HTTP Request 30000 41.4766 50 80 0 1041 0.00% 478.5/sec 9565.30
40k
----------------
HTTP Request 5000 15.6658 20 20 0 320 0.00% 286.0/sec 11241.78
HTTP Request 10000 32.2323 30 40 0 171 0.00% 289.2/sec 11368.57
HTTP Request 15000 48.0284 50 60 0 271 0.00% 289.8/sec 11394.05
HTTP Request 20000 63.1787 61 80 0 581 0.00% 289.9/sec 11396.58
HTTP Request 25000 74.3439 80 100 0 1042 0.00% 287.1/sec 11286.97
HTTP Request 30000 84.1055 90 120 0 1222 0.00% 286.4/sec 11258.84
80k
----------------
HTTP Request 5000 32.6708 30 40 0 151 0.00% 144.8/sec 11452.70
HTTP Request 10000 66.7363 70 70 0 301 0.00% 145.1/sec 11476.12
HTTP Request 15000 101.205 100 110 0 471 0.00% 145.1/sec 11482.73
HTTP Request 20000 135.362 130 141 0 610 0.00% 145.1/sec 11482.78
HTTP Request 25000 168.764 170 180 0 751 0.00% 145.2/sec 11484.08
HTTP Request 30000 203.819 190 261 0 1842 0.00% 144.0/sec 11394.47
160k
----------------
HTTP Request 5000 67.5972 70 80 10 191 0.00% 72.1/sec 11512.73
HTTP Request 10000 135.94 130 160 10 421 0.00% 72.2/sec 11533.44
HTTP Request 15000 208.653 200 240 10 1242 0.00% 70.8/sec 11306.89
HTTP Request 20000 281.632 261 321 10 1312 0.00% 69.9/sec 11163.95
HTTP Request 25000 356.928 320 430 10 1773 0.00% 69.1/sec 11024.46
HTTP Request 30000 432.508 391 591 10 2394 0.00% 68.1/sec 10872.46
Second set with more threads
---------------------------------------
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 10000 2.8969 0 10 0 571 0.00% 1678.1/sec 1730.58
HTTP Request 50000 6.615 0 20 0 320 0.00% 1399.3/sec 1443.07
HTTP Request 100000 70.106 0 100 0 2674 3.98% 829.9/sec 868.94
HTTP Request 150000 117.443 0 321 0 5428 3.88% 704.5/sec 737.30
10k
----------------
HTTP Request 10000 8.2566 0 10 0 321 0.00% 848.4/sec 8531.98
HTTP Request 50000 37.6230 40 81 0 2894 0.00% 721.8/sec 7259.02
HTTP Request 100000 117.799 10 210 0 7050 4.12% 524.9/sec 5092.10
HTTP Request 150000 297.357 300 490 0 9343 1.03% 397.1/sec 3958.41
-----------------------------------------------------------------------------------------------
Tomcat 5.5.4 - jdk1.5.0
-----------------------------------------------------------------------------------------------
PNG
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.6664 0 0 0 231 0.00% 1513.3/sec 1560.61
HTTP Request 10000 3.0191 0 10 0 260 0.00% 1457.9/sec 1503.50
HTTP Request 15000 2.849 0 10 0 1602 0.00% 1413.1/sec 1457.25
HTTP Request 20000 4.7782 0 10 0 1772 0.00% 1375.4/sec 1418.40
HTTP Request 25000 3.101 0 10 0 311 0.00% 1298.8/sec 1339.42
HTTP Request 30000 3.1751 0 10 0 1292 0.00% 1309.3/sec 1350.22
5k
----------------
HTTP Request 5000 2.7102 0 10 0 341 0.00% 1010.7/sec 5142.40
HTTP Request 10000 4.1149 0 10 0 270 0.00% 1056.6/sec 5376.05
HTTP Request 15000 4.44006 0 10 0 1772 0.00% 987.4/sec 5023.59
HTTP Request 20000 10.705 10 21 0 210 0.00% 1006.1/sec 5119.12
HTTP Request 25000 8.01844 0 30 0 1533 0.00% 947.4/sec 4820.27
HTTP Request 30000 17.336 10 40 0 1052 0.00% 921.2/sec 4687.00
10k
----------------
HTTP Request 5000 3.9182 0 10 0 440 0.00% 796.3/sec 8008.15
HTTP Request 10000 7.3054 0 10 0 431 0.00% 769.9/sec 7742.43
HTTP Request 15000 10.0121 10 20 0 2184 0.00% 729.9/sec 7340.61
HTTP Request 20000 12.4350 10 30 0 2974 0.00% 708.7/sec 7127.31
HTTP Request 25000 19.6953 20 40 0 520 0.00% 695.4/sec 6993.30
HTTP Request 30000 22.3808 10 50 0 1993 0.00% 676.1/sec 6799.01
20k
----------------
HTTP Request 5000 6.9646 0 10 0 421 0.00% 503.8/sec 10176.91
HTTP Request 10000 12.7935 10 20 0 2453 0.00% 506.9/sec 10239.85
HTTP Request 15000 27.4114 30 40 0 260 0.00% 504.3/sec 10187.86
HTTP Request 20000 23.1374 20 50 0 521 0.00% 473.9/sec 9573.79
HTTP Request 25000 31.359 30 70 0 1722 0.00% 459.1/sec 9273.74
HTTP Request 30000 46.1026 50 90 0 1322 0.00% 440.9/sec 8906.00
40k
----------------
HTTP Request 5000 15.7136 11 20 0 90 0.00% 282.7/sec 11328.62
HTTP Request 10000 32.3855 30 50 0 191 0.00% 284.2/sec 11386.25
HTTP Request 15000 48.282 50 70 0 310 0.00% 284.8/sec 11410.13
HTTP Request 20000 63.109 60 90 0 701 0.00% 281.5/sec 11280.46
HTTP Request 25000 80.866 80 111 0 901 0.00% 277.2/sec 11108.15
HTTP Request 30000 95.330 100 131 0 1012 0.00% 275.4/sec 11033.62
80k
----------------
HTTP Request 5000 32.8738 30 40 0 130 0.00% 142.7/sec 11472.80
HTTP Request 10000 67.3591 61 80 0 281 0.00% 143.0/sec 11498.89
HTTP Request 15000 103.351 100 111 0 590 0.00% 141.3/sec 11362.22
HTTP Request 20000 138.734 130 150 0 862 0.00% 140.3/sec 11280.84
HTTP Request 25000 176.043 161 190 0 1132 0.00% 137.8/sec 11075.73
HTTP Request 30000 217.386 190 281 0 1221 0.00% 133.6/sec 10741.04
160k
----------------
HTTP Request 5000 69.147 70 90 10 420 0.00% 68.6/sec 10977.84
HTTP Request 10000 136.539 130 150 10 481 0.00% 71.6/sec 11451.53
HTTP Request 15000 207.492 200 230 10 891 0.00% 70.9/sec 11351.74
HTTP Request 20000 279.590 270 321 10 1041 0.00% 70.3/sec 11251.54
HTTP Request 25000 350.897 321 481 10 1262 0.00% 69.4/sec 11105.76
HTTP Request 30000 431.377 401 651 10 1522 0.00% 67.9/sec 10859.00
HTML
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.1616 0 0 0 110 0.00% 1513.3/sec 1678.84
HTTP Request 10000 2.1729 0 10 0 270 0.00% 1510.8/sec 1676.05
HTTP Request 15000 7.2606 10 10 0 191 0.00% 1414.4/sec 1569.13
HTTP Request 20000 11.1337 10 20 0 300 0.00% 1360.5/sec 1509.25
HTTP Request 25000 15.6127 20 30 0 320 0.00% 1295.5/sec 1437.16
HTTP Request 30000 20.3894 20 30 0 171 0.00% 1274.2/sec 1413.58
5k
----------------
HTTP Request 5000 2.123 0 10 0 190 0.00% 1029.4/sec 5454.84
HTTP Request 10000 3.6245 0 10 0 250 0.00% 1025.2/sec 5432.47
HTTP Request 15000 8.8206 10 20 0 260 0.00% 1009.3/sec 5348.03
HTTP Request 20000 15.0216 20 30 0 961 0.00% 950.1/sec 5034.52
HTTP Request 25000 18.8263 20 30 0 260 0.00% 957.6/sec 5074.14
HTTP Request 30000 25.9440 30 40 0 100 0.00% 947.1/sec 5018.46
HTTP Request 5000 1.1616 0 0 0 110 0.00% 1513.3/sec 1678.84
10k
----------------
HTTP Request 5000 2.9382 0 10 0 301 0.00% 772.9/sec 7897.49
HTTP Request 10000 5.7132 0 10 0 260 0.00% 761.1/sec 7776.68
HTTP Request 15000 17.4331 20 30 0 140 0.00% 753.0/sec 7694.49
HTTP Request 20000 25.6429 30 40 0 60 0.00% 727.5/sec 7433.81
HTTP Request 25000 31.9246 30 50 0 331 0.00% 709.2/sec 7246.65
HTTP Request 30000 39.2613 40 60 0 280 0.00% 692.8/sec 7078.96
20k
----------------
HTTP Request 5000 6.053 0 10 0 191 0.00% 521.2/sec 10417.07
HTTP Request 10000 9.9496 10 20 0 701 0.00% 509.7/sec 10188.75
HTTP Request 15000 25.2590 30 40 0 301 0.00% 502.1/sec 10036.63
HTTP Request 20000 37.0592 40 50 0 220 0.00% 489.1/sec 9776.85
HTTP Request 25000 49.3775 50 70 0 150 0.00% 479.0/sec 9573.85
HTTP Request 30000 60.382 60 80 0 791 0.00% 471.6/sec 9426.80
40k
----------------
HTTP Request 5000 15.3846 10 20 0 81 0.00% 285.6/sec 11228.93
HTTP Request 10000 30.7539 30 40 0 161 0.00% 288.1/sec 11325.99
HTTP Request 15000 45.5470 41 60 0 611 0.00% 286.1/sec 11248.21
HTTP Request 20000 56.5293 60 90 0 561 0.00% 286.0/sec 11243.23
HTTP Request 25000 72.3456 70 120 0 1853 3.86% 265.0/sec 10029.05
HTTP Request 30000 87.0452 80 150 0 1462 2.93% 265.7/sec 10151.86
80k
----------------
HTTP Request 5000 32.3308 30 40 0 130 0.00% 144.9/sec 11466.31
HTTP Request 10000 65.5139 60 71 0 300 0.00% 145.2/sec 11486.12
HTTP Request 15000 100.332 100 110 0 601 0.00% 143.5/sec 11354.08
HTTP Request 20000 135.727 130 150 0 821 0.00% 142.4/sec 11266.61
HTTP Request 25000 172.576 160 200 0 981 0.00% 139.4/sec 11029.46
HTTP Request 30000 210.226 181 281 0 1282 0.00% 135.5/sec 10716.40
160k
----------------
HTTP Request 5000 67.8668 70 90 10 360 0.00% 68.8/sec 10990.31
HTTP Request 10000 135.815 130 150 10 521 0.00% 71.8/sec 11456.39
HTTP Request 15000 206.685 200 231 10 801 0.00% 71.1/sec 11343.90
HTTP Request 20000 279.416 261 311 10 1082 0.00% 70.4/sec 11235.92
HTTP Request 25000 352.919 330 490 10 1332 0.00% 69.2/sec 11054.11
HTTP Request 30000 431.188 400 681 10 2093 0.00% 67.6/sec 10793.20
-----------------------------------------------------------------------------------------------
Tomcat 5.5.4 - jdk1.5.0 -server
-----------------------------------------------------------------------------------------------
PNG
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.892 0 10 0 391 0.00% 1460.3/sec 1505.91
HTTP Request 10000 3.1386 0 10 0 301 0.00% 1470.6/sec 1516.54
HTTP Request 15000 2.57533 0 10 0 280 0.00% 1401.1/sec 1444.87
HTTP Request 20000 3.87705 0 10 0 1322 0.00% 1345.7/sec 1387.77
HTTP Request 25000 3.83376 0 10 0 281 0.00% 1285.5/sec 1325.65
HTTP Request 30000 14.7003 0 20 0 2113 0.37% 1162.9/sec 1200.97
5k
----------------
HTTP Request 5000 3.523 0 10 0 1081 0.00% 842.0/sec 4284.18
HTTP Request 10000 5.3949 0 10 0 311 0.00% 1046.8/sec 5325.96
HTTP Request 15000 5.13333 0 10 0 280 0.00% 1018.3/sec 5180.80
HTTP Request 20000 10.4405 10 20 0 2354 0.00% 956.0/sec 4864.14
HTTP Request 25000 5.84172 0 20 0 1973 0.00% 959.8/sec 4883.37
HTTP Request 30000 4.22843 0 10 0 1763 0.00% 958.0/sec 4874.24
10k
----------------
HTTP Request 5000 4.1946 0 10 0 261 0.00% 777.7/sec 7821.31
HTTP Request 10000 8.6547 10 20 0 260 0.00% 772.3/sec 7766.35
HTTP Request 15000 16.6364 20 30 0 420 0.00% 751.5/sec 7557.97
HTTP Request 20000 13.8763 10 30 0 2213 0.00% 720.2/sec 7242.81
HTTP Request 25000 31.5524 30 50 0 130 0.00% 714.3/sec 7183.11
HTTP Request 30000 17.0712 10 50 0 351 0.00% 686.6/sec 6904.98
20k
----------------
HTTP Request 5000 6.0528 0 10 0 781 0.00% 513.1/sec 10365.95
HTTP Request 10000 13.1713 10 20 0 640 0.00% 508.9/sec 10281.02
HTTP Request 15000 18.1922 10 30 0 2454 0.00% 489.3/sec 9885.09
HTTP Request 20000 29.7631 30 50 0 2293 0.00% 482.4/sec 9745.13
HTTP Request 25000 33.9482 31 60 0 2093 0.00% 460.7/sec 9306.21
HTTP Request 25000 33.9482 31 60 0 2093 0.00% 460.7/sec 9306.21
40k
----------------
HTTP Request 5000 15.6274 20 20 0 170 0.00% 281.0/sec 11257.96
HTTP Request 10000 32.2927 30 40 0 220 0.00% 284.2/sec 11386.25
HTTP Request 15000 47.6169 50 60 0 260 0.00% 283.6/sec 11364.82
HTTP Request 20000 61.2620 60 80 0 621 0.00% 280.3/sec 11231.30
HTTP Request 25000 78.0002 80 110 0 811 0.00% 277.6/sec 11124.31
HTTP Request 30000 95.8678 100 131 0 951 0.00% 273.4/sec 10954.09
80k
----------------
HTTP Request 5000 32.9252 30 40 0 120 0.00% 142.5/sec 11459.72
HTTP Request 10000 66.7771 70 71 0 280 0.00% 142.7/sec 11475.91
HTTP Request 15000 103.006 100 111 0 1993 0.00% 141.2/sec 11350.46
HTTP Request 20000 139.612 130 150 0 861 0.00% 139.9/sec 11245.26
HTTP Request 25000 177.084 161 191 0 931 0.00% 137.0/sec 11013.77
HTTP Request 30000 218.414 190 281 0 1282 0.00% 132.8/sec 10674.87
160k
----------------
HTTP Request 5000 67.9506 70 80 10 441 0.00% 69.9/sec 11182.22
HTTP Request 10000 136.658 130 150 10 481 0.00% 71.5/sec 11441.71
HTTP Request 15000 208.364 200 230 10 812 0.00% 70.7/sec 11313.16
HTTP Request 20000 281.053 261 331 10 1141 0.00% 70.0/sec 11197.17
HTTP Request 25000 354.481 331 490 10 1402 0.00% 68.8/sec 11012.99
HTTP Request 30000 436.092 401 671 10 1733 0.00% 67.1/sec 10735.91
HTML
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.8492 0 10 0 210 0.00% 1464.1/sec 1624.27
HTTP Request 10000 2.8275 0 10 0 240 0.00% 1510.8/sec 1676.05
HTTP Request 15000 3.40306 0 10 0 1302 0.00% 1454.2/sec 1613.25
HTTP Request 20000 4.03345 0 10 0 1382 0.00% 1407.5/sec 1561.40
HTTP Request 25000 5.16272 0 20 0 1793 0.00% 1369.4/sec 1519.19
HTTP Request 30000 5.01076 0 20 0 1302 0.00% 1313.9/sec 1457.59
5k
----------------
HTTP Request 5000 2.6718 0 10 0 240 0.00% 1060.0/sec 5616.74
HTTP Request 10000 4.7665 0 10 0 391 0.00% 1053.4/sec 5581.83
HTTP Request 15000 3.5168 0 10 0 1062 0.00% 1028.7/sec 5451.10
HTTP Request 20000 13.072 10 30 0 240 0.00% 972.3/sec 5152.00
HTTP Request 25000 16.5166 20 30 0 981 0.00% 962.4/sec 5099.54
HTTP Request 30000 20.9467 20 40 0 190 0.00% 985.7/sec 5223.26
10k
----------------
HTTP Request 5000 4.3042 0 10 0 310 0.00% 800.1/sec 8175.53
HTTP Request 10000 8.6168 10 10 0 2423 0.00% 759.4/sec 7758.96
HTTP Request 15000 15.3354 20 30 0 190 0.00% 758.0/sec 7745.43
HTTP Request 20000 9.0132 0 30 0 511 0.00% 725.4/sec 7412.24
HTTP Request 25000 30.4356 30 50 0 231 0.00% 724.6/sec 7404.18
HTTP Request 30000 18.7584 10 50 0 3115 0.00% 693.8/sec 7088.78
20k
----------------
HTTP Request 5000 6.5512 0 10 0 350 0.00% 530.0/sec 10593.75
HTTP Request 10000 12.5811 10 20 0 2293 0.00% 520.4/sec 10401.35
HTTP Request 15000 18.5973 20 31 0 1853 0.00% 499.1/sec 9976.52
HTTP Request 20000 29.4064 30 50 0 531 0.00% 483.3/sec 9661.08
HTTP Request 25000 47.8664 50 70 0 261 0.00% 487.3/sec 9740.12
HTTP Request 30000 41.6154 40 80 0 881 0.00% 455.6/sec 9105.73
40k
----------------
HTTP Request 5000 15.6584 20 20 0 70 0.00% 287.1/sec 11286.97
HTTP Request 10000 31.7896 30 40 0 260 0.00% 288.9/sec 11355.43
HTTP Request 15000 48.1360 50 60 0 600 0.00% 287.3/sec 11293.45
HTTP Request 20000 60.3971 60 80 0 651 0.00% 285.2/sec 11212.76
HTTP Request 25000 76.3208 80 110 0 871 0.00% 281.9/sec 11081.69
HTTP Request 30000 92.5552 90 130 0 982 0.00% 279.2/sec 10975.63
80k
----------------
HTTP Request 5000 32.5116 30 40 0 130 0.00% 145.1/sec 11479.62
HTTP Request 10000 65.8675 60 71 0 291 0.00% 144.8/sec 11456.18
HTTP Request 15000 100.98 100 110 0 651 0.00% 143.9/sec 11383.60
HTTP Request 20000 136.99 130 150 0 951 0.00% 141.9/sec 11224.25
HTTP Request 25000 174.073 160 190 0 1071 0.00% 139.4/sec 11032.48
HTTP Request 30000 215.435 190 271 0 1342 0.00% 135.3/sec 10706.25
160k
----------------
HTTP Request 5000 65.3358 60 80 10 1172 0.00% 69.0/sec 11013.21
HTTP Request 10000 136.102 130 150 10 490 0.00% 71.6/sec 11430.96
HTTP Request 15000 207.431 200 230 10 881 0.00% 71.0/sec 11333.11
HTTP Request 20000 280.041 261 330 10 1102 0.00% 70.2/sec 11211.85
HTTP Request 25000 354.758 330 491 10 1432 0.00% 69.1/sec 11025.07
HTTP Request 30000 436.024 401 671 0 1462 0.00% 67.3/sec 10743.28
-----------------------------------------------------------------------------------------------
APACHE2
-----------------------------------------------------------------------------------------------
PNG
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 5.8208 0 10 0 2504 0.00% 424.2/sec 437.45
HTTP Request 10000 4.8268 0 10 0 370 0.00% 839.1/sec 865.36
HTTP Request 15000 4.2926 0 10 0 571 0.00% 1496.4/sec 1543.17
HTTP Request 20000 7.47635 10 20 0 731 0.00% 1486.0/sec 1532.43
HTTP Request 25000 10.6625 10 20 0 1091 0.00% 1437.2/sec 1482.11
HTTP Request 30000 4.97996 0 20 0 1572 0.00% 1371.0/sec 1413.83
5k
----------------
HTTP Request 5000 3.3068 0 10 0 300 0.00% 969.6/sec 4932.99
HTTP Request 10000 3.4129 0 10 0 1472 0.00% 980.0/sec 4986.17
HTTP Request 15000 6.0228 0 20 0 1001 0.00% 952.8/sec 4847.76
HTTP Request 20000 9.80465 10 20 0 1091 0.00% 1048.9/sec 5336.58
HTTP Request 25000 5.07212 0 10 0 1051 0.00% 1013.6/sec 5156.99
HTTP Request 30000 5.01986 0 10 0 681 0.00% 999.9/sec 5087.38
10k
----------------
HTTP Request 5000 3.9978 0 10 0 370 0.00% 828.0/sec 8326.41
HTTP Request 10000 6.1832 0 10 0 150 0.00% 815.2/sec 8198.13
HTTP Request 15000 8.308 0 20 0 1832 0.00% 776.9/sec 7812.80
HTTP Request 20000 20.7028 20 30 0 1181 0.00% 755.9/sec 7601.97
HTTP Request 25000 22.9312 20 40 0 2293 0.00% 716.7/sec 7208.03
HTTP Request 30000 16.9571 10 40 0 2985 0.00% 711.4/sec 7154.19
20k
----------------
HTTP Request 5000 8.1018 10 10 0 872 0.00% 493.3/sec 9966.04
HTTP Request 10000 13.3857 10 20 0 571 0.00% 528.3/sec 10673.20
HTTP Request 15000 22.4586 20 31 0 3355 0.00% 502.6/sec 10153.72
HTTP Request 20000 28.2896 30 50 0 1361 0.00% 486.3/sec 9823.32
HTTP Request 25000 34.8244 40 60 0 2594 0.00% 488.2/sec 9861.35
HTTP Request 30000 45.4133 50 80 0 2513 0.00% 464.5/sec 9383.82
40k
----------------
HTTP Request 5000 16.7778 10 10 0 2163 0.00% 195.6/sec 7839.21
HTTP Request 10000 32.4661 30 41 0 220 0.00% 282.2/sec 11305.93
HTTP Request 15000 49.8748 50 60 0 331 0.00% 285.3/sec 11431.83
HTTP Request 20000 66.8595 60 91 0 561 0.00% 273.8/sec 10972.64
HTTP Request 25000 82.3806 80 100 0 1452 0.00% 283.4/sec 11355.33
HTTP Request 30000 96.7142 100 120 0 1172 0.00% 279.9/sec 11213.96
80K
----------------
HTTP Request 5000 33.6432 30 40 0 301 0.00% 141.6/sec 11384.75
HTTP Request 10000 67.5723 70 80 0 291 0.00% 142.9/sec 11489.19
HTTP Request 15000 102.460 100 111 0 500 0.00% 141.7/sec 11394.54
HTTP Request 20000 139.128 131 150 0 821 0.00% 140.2/sec 11269.77
HTTP Request 25000 176.855 170 190 0 1662 0.00% 137.9/sec 11087.95
HTTP Request 30000 216.385 200 260 0 1953 0.00% 134.0/sec 10774.25
160K
----------------
HTTP Request 5000 67.5414 70 71 10 330 0.00% 71.7/sec 11477.90
HTTP Request 10000 140.936 131 150 10 792 0.00% 69.6/sec 11136.23
HTTP Request 15000 221.052 200 231 10 1061 0.00% 66.7/sec 10679.47
HTTP Request 20000 304.168 270 391 10 1332 0.00% 65.1/sec 10413.34
HTTP Request 25000 384.937 340 721 10 1603 0.00% 64.0/sec 10241.25
HTTP Request 30000 462.650 401 851 10 3065 0.00% 63.5/sec 10154.58
HTML
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.8826 0 10 0 170 0.00% 1402.5/sec 1555.93
HTTP Request 10000 3.5655 0 10 0 211 0.00% 1382.9/sec 1534.19
HTTP Request 15000 3.2414 0 10 0 1052 0.00% 1347.0/sec 1494.31
HTTP Request 20000 8.4199 10 20 0 931 0.00% 1319.2/sec 1463.46
HTTP Request 25000 14.5314 11 30 0 391 0.00% 1250.1/sec 1386.79
HTTP Request 30000 9.3723 0 20 0 1532 0.00% 1367.9/sec 1517.47
5k
----------------
HTTP Request 5000 2.9482 0 10 0 401 0.00% 1040.1/sec 5511.57
HTTP Request 10000 5.0844 0 10 0 220 0.00% 1068.0/sec 5659.33
HTTP Request 15000 4.422 0 10 0 250 0.00% 1023.8/sec 5425.05
HTTP Request 20000 9.7753 10 20 0 2073 0.00% 987.7/sec 5233.67
HTTP Request 25000 15.2892 10 30 0 1622 0.00% 996.6/sec 5280.66
HTTP Request 30000 20.1448 20 40 0 2233 0.00% 933.8/sec 4948.17
10k
----------------
HTTP Request 5000 3.996 0 10 0 260 0.00% 833.5/sec 8516.23
HTTP Request 10000 8.4435 10 20 0 271 0.00% 802.1/sec 8195.20
HTTP Request 15000 8.03033 0 20 0 2373 0.00% 754.2/sec 7706.49
HTTP Request 20000 15.8833 20 30 0 1422 0.00% 741.3/sec 7574.61
HTTP Request 25000 30.8566 30 50 0 2133 0.00% 729.1/sec 7449.75
HTTP Request 30000 11.5936 0 40 0 1823 0.00% 726.4/sec 7422.11
20k
----------------
HTTP Request 5000 7.0222 10 10 0 711 0.00% 536.8/sec 10730.23
HTTP Request 10000 13.06 10 20 0 2203 0.00% 517.7/sec 10346.97
HTTP Request 15000 23.8621 20 40 0 451 0.00% 523.5/sec 10464.70
HTTP Request 20000 33.3271 31 50 0 1031 0.00% 506.0/sec 10113.74
HTTP Request 25000 42.0548 40 61 0 1071 0.00% 488.7/sec 9768.87
HTTP Request 30000 39.2806 40 80 0 2714 0.00% 478.3/sec 9560.57
40k
----------------
HTTP Request 5000 15.69 10 20 0 260 0.00% 288.4/sec 11339.05
HTTP Request 10000 32.232 30 40 0 210 0.00% 290.3/sec 11411.47
HTTP Request 15000 48.9159 50 60 0 330 0.00% 290.7/sec 11429.38
HTTP Request 20000 65.1211 60 71 0 461 0.00% 291.0/sec 11441.52
HTTP Request 25000 81.9842 80 90 0 1882 0.00% 291.2/sec 11447.62
HTTP Request 30000 98.8285 91 110 0 1943 0.00% 291.3/sec 11450.47
80k
----------------
HTTP Request 5000 32.5254 30 40 0 160 0.00% 144.7/sec 11449.38
HTTP Request 10000 66.5089 70 71 0 300 0.00% 145.1/sec 11477.79
HTTP Request 15000 100.184 100 110 0 441 0.00% 145.2/sec 11488.29
HTTP Request 20000 134.834 130 141 0 601 0.00% 145.3/sec 11491.96
HTTP Request 25000 168.486 170 180 0 1052 0.00% 145.3/sec 11491.49
HTTP Request 30000 201.346 181 261 0 2263 0.00% 145.3/sec 11495.58
160k
----------------
HTTP Request 5000 67.4 70 71 10 221 0.00% 72.0/sec 11500.95
HTTP Request 10000 135.910 131 141 10 431 0.00% 72.1/sec 11509.33
HTTP Request 15000 205.038 200 211 10 661 0.00% 72.1/sec 11506.48
HTTP Request 20000 272.878 261 311 10 882 0.00% 72.1/sec 11510.53
HTTP Request 25000 344.372 320 420 10 2764 0.00% 71.5/sec 11422.88
HTTP Request 30000 417.623 370 551 10 2794 0.00% 70.6/sec 11268.21
-----------------------------------------------------------------------------------------------
APACHE1.3.3
-----------------------------------------------------------------------------------------------
PNG
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.9664 0 10 0 330 0.00% 1481.5/sec 1527.78
HTTP Request 10000 3.6726 0 10 0 421 0.00% 1440.9/sec 1485.95
HTTP Request 15000 3.8014 0 10 0 460 0.00% 1384.3/sec 1427.53
HTTP Request 20000 4.58095 0 10 0 841 0.00% 1315.6/sec 1356.73
HTTP Request 25000 3.79724 0 10 0 1152 0.00% 1280.8/sec 1320.83
HTTP Request 30000 6.55366 0 20 0 1322 0.00% 1314.5/sec 1355.60
5k
----------------
HTTP Request 5000 2.8888 0 10 0 651 0.00% 1033.7/sec 5259.35
HTTP Request 10000 4.979 0 10 0 631 0.00% 1026.3/sec 5221.56
HTTP Request 15000 7.7478 10 20 0 171 0.00% 1012.8/sec 5152.82
HTTP Request 20000 7.8936 0 20 0 661 0.00% 967.1/sec 4920.59
HTTP Request 25000 4.51812 0 10 0 1031 0.00% 963.9/sec 4904.09
HTTP Request 30000 23.9835 20 40 0 1732 0.00% 920.1/sec 4681.25
10k
----------------
HTTP Request 5000 4.3436 0 10 0 1101 0.00% 783.8/sec 7882.62
HTTP Request 10000 6.0235 0 10 0 902 0.00% 736.4/sec 7406.02
HTTP Request 15000 11.0494 10 20 0 1793 0.00% 734.9/sec 7390.97
HTTP Request 20000 22.8475 20 40 0 1192 0.00% 723.3/sec 7274.24
HTTP Request 25000 10.9638 0 30 0 1712 0.00% 724.0/sec 7281.09
HTTP Request 30000 15.7667 10 40 0 2674 0.00% 698.9/sec 7029.01
20k
----------------
HTTP Request 5000 7.3568 0 10 0 630 0.00% 532.3/sec 10753.31
HTTP Request 10000 13.1183 10 20 0 621 0.00% 525.8/sec 10622.13
HTTP Request 15000 21.6257 20 30 0 2374 0.00% 493.7/sec 9973.26
HTTP Request 20000 32.4598 30 50 0 1252 0.00% 500.4/sec 10108.93
HTTP Request 25000 29.2089 20 60 0 1942 0.00% 474.8/sec 9591.29
HTTP Request 30000 34.6680 30 70 0 2263 0.00% 470.1/sec 9497.20
40k
----------------
HTTP Request 5000 16.085 20 20 0 290 0.00% 283.0/sec 11340.81
HTTP Request 10000 32.9898 30 50 0 340 0.00% 284.6/sec 11402.45
HTTP Request 15000 49.0009 50 70 0 341 0.00% 285.8/sec 11451.65
HTTP Request 20000 65.1618 60 90 0 1272 0.00% 285.5/sec 11440.05
HTTP Request 25000 80.6495 80 120 0 2033 0.00% 286.1/sec 11463.32
HTTP Request 30000 97.6662 90 131 0 1693 0.00% 286.1/sec 11463.56
80k
----------------
HTTP Request 5000 32.8414 30 40 0 260 0.00% 140.7/sec 11311.07
HTTP Request 10000 67.0141 70 80 0 281 0.00% 143.2/sec 11512.22
HTTP Request 15000 102.438 100 120 0 550 0.00% 142.0/sec 11416.11
HTTP Request 20000 138.336 130 151 0 781 0.00% 140.6/sec 11300.66
HTTP Request 25000 174.804 170 200 0 1052 0.00% 138.3/sec 11119.91
HTTP Request 30000 214.393 190 270 0 1332 0.00% 134.8/sec 10837.71
160k
----------------
HTTP Request 5000 67.1822 60 90 10 400 0.00% 68.7/sec 10987.03
HTTP Request 10000 135.505 130 150 10 631 0.00% 71.8/sec 11484.41
HTTP Request 15000 204.779 200 240 10 701 0.00% 71.2/sec 11399.24
HTTP Request 20000 277.855 261 330 10 1022 0.00% 70.5/sec 11286.10
HTTP Request 25000 349.946 330 461 10 1301 0.00% 69.6/sec 11129.61
HTTP Request 30000 426.468 400 651 10 2654 0.00% 68.2/sec 10919.60
HTML
1K
-----------------------------------------------------------------------------------------------
protocol | samples | average | median | 90% line | min | max | error%
| throughput | Kb/sec
-----------------------------------------------------------------------------------------------
HTTP Request 5000 1.9008 0 0 0 420 0.00% 1451.4/sec 1610.12
HTTP Request 10000 3.4541 0 10 0 361 0.00% 1447.2/sec 1605.46
HTTP Request 15000 3.15666 0 10 0 340 0.00% 1417.1/sec 1572.09
HTTP Request 20000 4.5215 0 10 0 1513 0.00% 1320.8/sec 1465.30
HTTP Request 25000 14.6438 10 20 0 1222 0.00% 1309.8/sec 1453.05
HTTP Request 30000 7.93206 0 20 0 1773 0.00% 1315.7/sec 1459.58
5k
----------------
HTTP Request 5000 3.0762 0 10 0 581 0.00% 1018.7/sec 5398.15
HTTP Request 10000 6.9888 10 10 0 431 0.00% 1013.8/sec 5371.89
HTTP Request 15000 9.01366 10 20 0 360 0.00% 997.2/sec 5284.03
HTTP Request 20000 17.703 20 30 0 241 0.00% 962.9/sec 5102.39
HTTP Request 25000 5.51036 0 10 0 2013 0.00% 960.1/sec 5087.59
HTTP Request 30000 6.0325 0 10 0 1583 0.00% 928.0/sec 4917.40
10k
----------------
HTTP Request 5000 4.0482 0 10 0 311 0.00% 787.5/sec 8046.76
HTTP Request 10000 8.9447 10 20 0 1321 0.00% 750.8/sec 7671.00
HTTP Request 15000 8.50453 0 20 0 1572 0.00% 732.1/sec 7480.43
HTTP Request 20000 8.5098 0 20 0 1703 0.00% 726.7/sec 7425.71
HTTP Request 25000 9.52312 0 20 0 1812 0.00% 714.3/sec 7298.41
HTTP Request 30000 17.2165 10 40 0 2333 0.00% 682.7/sec 6975.70
20k
----------------
HTTP Request 5000 7.1404 0 10 0 591 0.00% 530.6/sec 10604.99
HTTP Request 10000 13.4822 10 20 0 521 0.00% 530.6/sec 10605.55
HTTP Request 15000 20.875 20 40 0 1492 0.00% 507.0/sec 10135.02
HTTP Request 20000 32.6185 30 50 0 1762 0.00% 496.2/sec 9917.77
HTTP Request 25000 30.834 30 60 0 1693 0.00% 486.0/sec 9713.61
HTTP Request 30000 37.903 30 80 0 2414 0.00% 466.8/sec 9331.31
40k
----------------
HTTP Request 5000 15.7246 10 20 0 221 0.00% 286.5/sec 11261.10
HTTP Request 10000 31.7105 30 50 0 210 0.00% 290.4/sec 11414.78
HTTP Request 15000 47.8250 50 70 0 331 0.00% 291.1/sec 11444.91
HTTP Request 20000 63.8026 60 90 0 441 0.00% 291.2/sec 11448.19
HTTP Request 25000 79.1850 70 120 0 1652 0.00% 291.3/sec 11452.96
HTTP Request 30000 94.0337 90 130 0 2114 0.00% 288.0/sec 11323.92
80k
----------------
HTTP Request 5000 32.7874 30 40 0 291 0.00% 144.5/sec 11432.84
HTTP Request 10000 66.1758 70 71 0 291 0.00% 145.4/sec 11499.47
HTTP Request 15000 98.1107 100 110 0 451 0.00% 145.5/sec 11508.45
HTTP Request 20000 135.668 130 150 0 1072 0.00% 143.2/sec 11330.42
HTTP Request 25000 170.987 170 181 0 1322 0.00% 142.9/sec 11304.63
HTTP Request 30000 206.496 190 240 0 2353 0.00% 141.3/sec 11178.42
160k
----------------
HTTP Request 5000 67.0802 70 80 10 380 0.00% 71.9/sec 11481.11
HTTP Request 10000 139.966 130 160 10 791 0.00% 70.0/sec 11174.54
HTTP Request 15000 218.777 200 241 10 1052 0.00% 67.1/sec 10711.30
HTTP Request 20000 301.358 270 381 10 1682 0.00% 65.5/sec 10464.84
HTTP Request 25000 380.382 331 691 10 2313 0.00% 64.6/sec 10318.08
HTTP Request 30000 456.479 400 841 10 1973 0.00% 64.2/sec 10254.49
---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org
Re: latest set of Benchmark results
Posted by Peter Lin <wo...@gmail.com>.
quick explanation of errors for 40K png test. The errors were the
result of OS and not Tomcat. For some odd reason, after a couple of
hours of benchmarks, the OS stopped accepting connections. I will
re-run that one test later for my final write up.
I've posted updated testplans including 4 with gzip header.
http://cvs.apache.org/~woolfel/testplans.zip
peter lin
---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org
Re: latest set of Benchmark results
Posted by Remy Maucherat <re...@gmail.com>.
On Sun, 16 Jan 2005 13:15:01 -0500, Peter Lin <wo...@gmail.com> wrote:
> Here is the latest set of benchmark results. I discovered an error in
> my test plan for 40K PNG, so the results for that one was off. All of
> the other results should be accurate. I re-ran the tests.
>
> Server:
> AMD 2ghz
> 1Gb RAM
> Redhat FedoraCore1
>
> Client:
> Gateway laptop 450
> 1.4ghz centrino
> Windows XP pro
> jdk1.4.2
> jmeter nightly build
>
> 16 port Switch Linksys 10/100
> CAT5 cables
>
> All threads ran for 1000 iterations.
> thread scenario: 5, 10, 15, 20, 25, 30
> image/html size: 1, 10, 20, 40, 80, 160
>
> The test includes 5.0.19 (aka 5.0), 5.5.4, apache 2.0.50, apache
> 1.3.3. I hope people find it interesting and useful. It will take me
> a week or two to write up the results and generate the graphs.
Does the "-server" option do anything other than use more memory ? ;)
--
xxxxxxxxxxxxxxxxxxxxxxxxx
Rémy Maucherat
Developer & Consultant
JBoss Group (Europe) SàRL
xxxxxxxxxxxxxxxxxxxxxxxxx
---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-user-help@jakarta.apache.org