You are viewing a plain text version of this content. The canonical link for it is here.
Posted to modperl@perl.apache.org by Joshua Chamas <jo...@chamas.com> on 2001/06/13 20:05:54 UTC
[ANNOUNCE] Hello World Benchmark Suite, latest release
Hey,
I have released the latest Hello World benchmark suite, which you
can find at http://www.chamas.com/bench/hello.tar.gz ... Enjoy!
--Josh
CHANGES
1) Apache::Registry Hello World 2000 benchmark added, fastest of group,
showing perl's raw template rendering power!
2) New XSLT AxKit and Apache::ASP benchmarks with XML::Sablotron
DISCLAIMER: Like any benchmarks, these test no more than they test for.
Fortunately you have can run them for yourself on YOUR hardware, and
recommend any improvements as you see fit to the benchmark suite, or
even add some tests for environments not covered already!
SPEED NOTES:
1) These were run on a dual proc CPU PIII 450 which seems to have a
lower relative bench for the HTML static test than on sincle proc CPU
2) HTML::Embperl v2.x is much faster than 1.3.0 on the h2000 bench,
last I remember faster than Apache::ASP, about the same as PHP
I decided to run 1.3.0, since its what I get from a CPAN install.
3) HTML::Mason was about as fast as Apache::ASP on the h2000
benchmark, but since 1.x was released, is much slower.
BENCHMARK RESULTS
hello]# ./bench.pl -time=60 -version
Test Name Test File Hits/sec Total Hits Total Time sec/Hits Bytes/Hit
------------ ---------- ---------- ---------- ---------- ---------- ----------
Apache::ASP v2.15 2000 h2000.asp 224.5 13479 hits 60.04 sec 0.004454 28997 byte
Apache::Registry v2.01 2000 mod_per h2000.reg 335.0 20102 hits 60.01 sec 0.002985 28178 byte
HTML::Embperl v1.3.0 2000 h2000.epl 107.7 6463 hits 60.02 sec 0.009287 28840 byte
HTML::Mason v1.03 2000 h2000.mas 82.5 4954 hits 60.02 sec 0.012114 28798 byte
mod_caucho JSP 2000 h2000.jsp 315.3 18928 hits 60.03 sec 0.003171 28964 byte
mod_php PHP 2000 h2000.php 257.3 15448 hits 60.04 sec 0.003886 28865 byte
Template v2.00 Toolkit 2000 h2000.tt 53.7 3223 hits 60.02 sec 0.018621 28888 byte
Apache::ASP v2.15 hello.asp 371.9 22324 hits 60.02 sec 0.002689 241 bytes
Apache::Dispatch v0.08 handler hello/worl 635.0 38107 hits 60.01 sec 0.001575 196 bytes
Apache::ePerl hello.eper 337.3 20239 hits 60.01 sec 0.002965 217 bytes
Apache::Registry v2.01 CGI Raw hello_raw. 686.1 41172 hits 60.01 sec 0.001458 52 bytes
Apache::Registry v2.01 CGI.pm hello.cgi 449.6 26985 hits 60.02 sec 0.002224 216 bytes
Apache::SSI v2.16 hello.shtm 546.6 32802 hits 60.01 sec 0.001829 199 bytes
HTML static hello.html 1148.1 50000 hits 43.55 sec 0.000871 311 bytes
HTML::Embperl v1.3.0 hello.epl 466.4 27996 hits 60.02 sec 0.002144 220 bytes
HTML::Mason v1.03 hello.mas 361.5 21702 hits 60.02 sec 0.002766 197 bytes
HTML::Template v2.0 hello.htmp 551.3 33089 hits 60.02 sec 0.001814 198 bytes
mod_caucho JSP hello.jsp 835.6 50000 hits 59.84 sec 0.001197 230 bytes
mod_include SSI hello.shtm 979.5 50000 hits 51.05 sec 0.001021 198 bytes
mod_perl handler hello.benc 831.2 49887 hits 60.02 sec 0.001203 196 bytes
mod_php PHP hello.php 716.2 42975 hits 60.01 sec 0.001396 225 bytes
mod_speedycgi hello.cgi 294.4 17673 hits 60.03 sec 0.003397 216 bytes
Template v2.00 Toolkit hello.tt 509.7 30594 hits 60.02 sec 0.001962 198 bytes
Apache::ASP v2.15 XSLT Hello hxslt.xml 218.5 13113 hits 60.00 sec 0.004576 279 bytes
AxKit v1.4 XSLT Hello hxslt.xml 200.7 12046 hits 60.01 sec 0.004981 398 bytes
Apache Server Header Tokens
---------------------------
(Unix)
Apache/1.3.14
AxKit/1.4
OpenSSL/0.9.6
PHP/4.0.3pl1
Resin/1.2.1
mod_perl/1.24
mod_ssl/2.7.1
PERL Version: 5.00503
JAVA Version: java version "1.3.0"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.3.0)
Classic VM (build 1.3.0, J2RE 1.3.0 IBM build cx130-20001124 (JIT enabled: jitc))
Operating System: Linux 2.2.14-9.0 (root@gate) (gcc egcs-2.91.66) #1 2CPU [gate.]
Re: [ANNOUNCE] Hello World Benchmark Suite, latest release
Posted by Joshua Chamas <jo...@chamas.com>.
I have an update already ... Matt kindly told me to lose the
AxDebug 10 setting, now AxKit easily beats Apache::ASP
on the XSLT benchmark. Also, I have some new Tomcat/mod_jserv
benchmarks for Hello World and Hello World 2000.
As before, you can download the benchmarks at
http://www.chamas.com/bench/hello.tar.gz
--Josh
hello]# ./bench.pl -time 30 -version
Test Name Test File Hits/sec Total Hits Total Time sec/Hits Bytes/Hit
------------ ---------- ---------- ---------- ---------- ---------- ----------
Apache::ASP v2.15 2000 h2000.asp 223.5 6713 hits 30.03 sec 0.004474 28997 byte
Apache::Registry v2.01 2000 mod_per h2000.reg 339.1 10176 hits 30.00 sec 0.002949 28178 byte
HTML::Embperl v1.3.0 2000 h2000.epl 106.4 3195 hits 30.04 sec 0.009402 28840 byte
HTML::Mason v1.03 2000 h2000.mas 83.2 2498 hits 30.02 sec 0.012017 28798 byte
mod_caucho JSP 2000 h2000.jsp 323.2 9701 hits 30.01 sec 0.003094 28964 byte
mod_jserv JSP 2000 h2000.jsp 174.1 5225 hits 30.01 sec 0.005744 29407 byte
mod_php PHP 2000 h2000.php 232.4 6975 hits 30.01 sec 0.004303 28865 byte
Template v2.00 Toolkit 2000 h2000.tt 52.5 1576 hits 30.02 sec 0.019048 28888 byte
Apache::ASP v2.15 hello.asp 377.1 11326 hits 30.04 sec 0.002652 241 bytes
Apache::Dispatch v0.08 handler hello/worl 632.3 18971 hits 30.00 sec 0.001581 196 bytes
Apache::ePerl hello.eper 344.1 10332 hits 30.03 sec 0.002906 217 bytes
Apache::Registry v2.01 CGI Raw hello_raw. 697.4 20933 hits 30.02 sec 0.001434 52 bytes
Apache::Registry v2.01 CGI.pm hello.cgi 445.7 13380 hits 30.02 sec 0.002243 216 bytes
Apache::SSI v2.16 hello.shtm 555.2 16670 hits 30.02 sec 0.001801 199 bytes
HTML static hello.html 1135.9 34086 hits 30.01 sec 0.000880 311 bytes
HTML::Embperl v1.3.0 hello.epl 469.8 14103 hits 30.02 sec 0.002129 220 bytes
HTML::Mason v1.03 hello.mas 357.5 10738 hits 30.03 sec 0.002797 197 bytes
HTML::Template v2.0 hello.htmp 554.1 16631 hits 30.01 sec 0.001805 198 bytes
mod_caucho JSP hello.jsp 853.1 25605 hits 30.01 sec 0.001172 230 bytes
mod_include SSI hello.shtm 972.8 29195 hits 30.01 sec 0.001028 198 bytes
mod_jserv JSP hello.jsp 324.1 9752 hits 30.09 sec 0.003086 357 bytes
mod_perl handler hello.benc 687.5 20634 hits 30.01 sec 0.001454 196 bytes
mod_php PHP hello.php 610.6 18327 hits 30.01 sec 0.001638 225 bytes
mod_speedycgi hello.cgi 247.9 7447 hits 30.04 sec 0.004034 216 bytes
Template v2.00 Toolkit hello.tt 509.9 15303 hits 30.01 sec 0.001961 198 bytes
Apache::ASP v2.15 XSLT Hello hxslt.xml 221.5 6644 hits 30.00 sec 0.004516 279 bytes
AxKit v1.4 XSLT Hello hxslt.xml 285.4 8572 hits 30.03 sec 0.003503 398 bytes
Apache Server Header Tokens
---------------------------
(Unix)
Apache/1.3.14
AxKit/1.4
OpenSSL/0.9.6
PHP/4.0.3pl1
Resin/1.2.1
mod_perl/1.24
mod_ssl/2.7.1
tomcat/1.0
PERL Version: 5.00503
JAVA Version: java version "1.3.0"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.3.0)
Classic VM (build 1.3.0, J2RE 1.3.0 IBM build cx130-20001124 (JIT enabled: jitc))
Operating System: Linux 2.2.14-9.0 (root@gate) (gcc egcs-2.91.66) #1 2CPU [gate.]
Hello World Benchmark Suite, mod_cgi update
Posted by Joshua Chamas <jo...@chamas.com>.
Doug asked that I add some plain 'ol mod_cgi tests
to compare mod_perl to, so here you go!
hello]# ./bench.pl -time 10 CGI
Test Name Test File Hits/sec Total Hits Total Time sec/Hits Bytes/Hit
------------ ---------- ---------- ---------- ---------- ---------- ----------
Apache::Registry CGI Raw hello_raw. 591.6 5929 hits 10.02 sec 0.001690 52 bytes
Apache::Registry CGI.pm hello.cgi 406.2 4068 hits 10.02 sec 0.002462 216 bytes
mod_cgi CGI Raw hello_raw. 124.3 1243 hits 10.00 sec 0.008046 196 bytes
mod_cgi CGI.pm hello.cgi 9.2 99 hits 10.81 sec 0.109242 216 bytes
mod_speedycgi hello.cgi 248.8 2500 hits 10.05 sec 0.004019 216 bytes
The benchmark suite as usual is at
http://www.chamas.com/bench/hello.tar.gz
--Josh
_________________________________________________________________
Joshua Chamas Chamas Enterprises Inc.
NodeWorks <- Web Link Checking Huntington Beach, CA USA
http://www.nodeworks.com 1-714-625-4051