Apache Hello World Benchmarks

[Josh Chamas <jo...@chamas.com>]

Hey mod_perlers,

Its been years of benchmarking, and I finally put together
a site based on the data.  Check it out at:

   http://chamas.com/bench/

See how well mod_perl does?  You should all be proud :)

Regards,

Josh
________________________________________________________________
Josh Chamas, Founder                   phone:714-625-4051
Chamas Enterprises Inc.                http://www.chamas.com
NodeWorks Link Checking                http://www.nodeworks.com

Re: Apache Hello World Benchmarks

[Josh Chamas <jo...@chamas.com>]

Perrin Harkins wrote:
 >
> Despite the intentionally misleading nature of Microsoft's "benchmark", 
> it did get me thinking about what sort of benchmarking options exist for 
> comparing languages and platforms.  The "Hello World" and "Hello 2000" 
> benchmarks are pretty small (understandably so, given that it's one 
> person doing the coding for all environments).  A more realistic 
> benchmark would be nice to have, for PR reasons.
> 
> The Nile.com benchmark models an on-line bookstore and was used by eWeek 
> Labs as recently as February to compare database performance (using 
> identical Java code and varying the database behind it).  It's a 
> relatively small application and would probably not take a lot of work 
> to implement on mod_perl.  Versions for ASP and JSP already exist and 
> source code is available.
> 

It would be good to see someone do this for mod_perl.  None
of the benchmarks I have done so far get anywhere near testing
the scalability of systems in the real world, and it would
be good to see this done.

As a next step for the hello world benchmarks, I'll probably do
a cross platform benchmark while hitting a MySQL database.  An insert,
delete, update, and 10-20 selects probably, but it will still
be a small code base being hit.

> On a totally different note, it would be fun to see how mod_perl 2 is 
> stacking up on the Hello and Hello 2000 tests.
> 

Will do.

--Josh
________________________________________________________________
Josh Chamas, Founder                   phone:714-625-4051
Chamas Enterprises Inc.                http://www.chamas.com
NodeWorks Link Checking                http://www.nodeworks.com

Re: Apache Hello World Benchmarks

[Perrin Harkins <pe...@elem.com>]

Josh Chamas wrote:

> Its been years of benchmarking, and I finally put together
> a site based on the data. 


It looks good.  I recently looked at one of the benchmarks that 
Microsoft uses to tout their superiority over Java.  Their test results 
are pure FUD, since they use totally different database servers when 
testing .NET and Java.  (They also ran the Java stuff on Linux, as if it 
didn't run perfectly well on Win2K.  Whatever.)

Despite the intentionally misleading nature of Microsoft's "benchmark", 
it did get me thinking about what sort of benchmarking options exist for 
comparing languages and platforms.  The "Hello World" and "Hello 2000" 
benchmarks are pretty small (understandably so, given that it's one 
person doing the coding for all environments).  A more realistic 
benchmark would be nice to have, for PR reasons.

The Nile.com benchmark models an on-line bookstore and was used by eWeek 
Labs as recently as February to compare database performance (using 
identical Java code and varying the database behind it).  It's a 
relatively small application and would probably not take a lot of work 
to implement on mod_perl.  Versions for ASP and JSP already exist and 
source code is available.

Publishing a comparison to the JSP implementation using an identical 
database and hardware with respectable numbers on the mod_perl side 
might provide a useful data point when dealing with people who think 
Java is faster than Perl.  Who knows, maybe we could even get eWeek 
interested in talking about mod_perl the next time they write one of 
these comparison articles.  If mod_perl 2 is ready for it yet on 
Windows, we could compare it to the .NET performance too.  Is anyone 
else interested in  working on a mod_perl version of this test?

On a totally different note, it would be fun to see how mod_perl 2 is 
stacking up on the Hello and Hello 2000 tests.

- Perrin