FW: mirroring

[Steven Noels <st...@outerthought.org>]

Some interesting analysis forwarded from infrastructure@apache.org...

We should create light-weight pages, too!

</Steven>

-----Original Message-----
From: gregames@www2.kc.aoindustries.com
[mailto:gregames@www2.kc.aoindustries.com]On Behalf Of Greg Ames
Sent: donderdag 23 mei 2002 23:52
To: infrastructure
Subject: Re: mirroring


Joshua Slive wrote:

> One solution is to forget about mirroring the websites and only mirror
the
> software distributions.  This is much simpler, and should drastically
> reduce the bandwidth requirements for apache.org.  How much?  I
couldn't
> tell you that without doing some log analysis.

I went thru yesterday's log from daedalus and added up the bytes sent
per URL.
The top 20 culprits are attached.  It supports your thoughts about
mirroring the
distributions.

One surprise was seeing jakarta.apache.org/ (the doc root) show up. The
log
contains over 157,000 GETS for jakarta's / at around 33K bytes each when
we
actually serve it.

> 2. Move the projects which currently have their own dist/ directory
under
> the www.apache.org/dist directory.  Note that we tried this once
before
> with jakarta, and it crashed badly.  The problem was that jakarta has
TONS
> of stuff under builds/ including nightly builds and other garbage.

I wonder if moving just the builds/jakarata-*/release/ stuff to
www.apache.org/dist would be more managable?

xml has a couple of its own dist/ directories with popular files.

Greg