You are viewing a plain text version of this content. The canonical link for it is here.
Posted to cvs@httpd.apache.org by br...@hyperreal.org on 1998/07/10 01:29:13 UTC

cvs commit: apache-site/info how-to-mirror.html

brian       98/07/09 16:29:13

  Modified:    info     how-to-mirror.html
  Log:
  Updated with "cvsup" and "rsync" information.
  
  Revision  Changes    Path
  1.10      +91 -36    apache-site/info/how-to-mirror.html
  
  Index: how-to-mirror.html
  ===================================================================
  RCS file: /export/home/cvs/apache-site/info/how-to-mirror.html,v
  retrieving revision 1.9
  retrieving revision 1.10
  diff -u -r1.9 -r1.10
  --- how-to-mirror.html	1998/06/21 23:45:51	1.9
  +++ how-to-mirror.html	1998/07/09 23:29:12	1.10
  @@ -11,44 +11,102 @@
    ALINK="#FF0000"
   >
   <DIV ALIGN="CENTER">
  -<IMG
  - SRC="../images/apache_sub.gif"
  - ALT="[APACHE DOCUMENTATION]"
  ->
  +<IMG SRC="../images/apache_sub.gif" ALT="[APACHE DOCUMENTATION]">
   </DIV>
   
   <H1 ALIGN="CENTER">How to Become a Mirror of the Apache Web Site</H1>
   
  +Apache has over 150 different mirror sites around the world.  If you
  +are in a part of the world which seems poory served by any existing
  +mirror, we would encourage you to set up a local mirror of the
  +www.apache.org web site for you and others in your part of the world to
  +use.  So that others may find it, we'll list it on our "mirrors" web
  +page, too.
  +
   <H2>Requirements</H2>
   
  -It is easy to become a mirror.  There are only a couple of 
  -requirements:
  +We have a few requirements for those wishing to run a mirror:
   
   <UL>
  -  <LI>You must carry the complete site.
  +  <LI>You must carry the complete site, with no "local" changes.
     <LI>You must do an update-check at least twice a week.
     <LI>You must subscribe to the mailing list for mirror maintainers.
  +  <LI>Set the configuration <CODE>DocumentIndex index.html</CODE>.
  +  <LI>Enable server-side includes, i.e. <CODE>Options Includes</CODE> or
  +      <CODE>Options IncludesNoExec</CODE>.
   </UL>
   
  -Note that the site, as of this writing (June 1998) is approximately 65 megabytes.
  +Note that the site, as of this writing (June 1998) is approximately 65
  +megabytes.
   
   <P>
   
  -More requirements may be placed at some point in the future, but for now that's all there is.  There are a couple things which are highly recommended:
  +More requirements may be placed at some point in the future, but for
  +now that's all there is.  There are a couple things which are highly
  +recommended:
   
   <UL>
     <LI>Run your mirroring software between midnight and 4am Pacific Standard Time
         (8am-noon GMT) when traffic to www.apache.org is at its lowest.
  -  <LI>Consider setting up both a web site and FTP site, at least for the /dist
  -      directory.
  +  <LI>Consider also making the "dist" subdirectory available via FTP.  It is not
  +      particularly helpful to mirror the complete web site for FTP, since many
  +      pages use server-side includes, and directories get listed rather than 
  +      serving up "index.html".
   </UL>
   
  +<H2>Mirroring Techniques</H2>
  +
  +There are a couple different ways to mirror the Apache web site.  Here
  +is the list of ways we make available, in order of decreasing preference:
  +
  +<OL> 
  +
  +<LI>Use the "CVSup" package.  This is a package which uses the
  +versioning scheme in CVS to determine exactly which parts of which
  +files changed between accesses, and is thus by far the most efficient
  +mechanism for transferring files.  The best place to find out more
  +about CVSup is at the CVSup FAQ, at <A
  +HREF="http://www.polstra.com/projects/freeware/CVSup/faq.html">
  +http://www.polstra.com/projects/freeware/CVSup/faq.html</A>.  There
  +are binaries for Linux, *BSD, Solaris, SunOS, Alpha/OSF-1, HPPA-10.20,
  +and Irix 6.
  +
  +<P>After you've set up the client binary, use the following as a "supfile":
  +
  +<BLOCKQUOTE><PRE>
  +*default host=dev.apache.org
  +*default base=(wherever you want)
  +*default prefix=(wherever you want)
  +apache-site
  +</BLOCKQUOTE></PRE>
  +
  +<P>
  +
  +Of course, you can also fetch the Apache 1.2 and 1.3 CVS trees
  +(<CODE>apache-1.2</CODE> or <CODE>apache-1.3</CODE>), just the docs
  +for each of those (<CODE>apache-1.2-docs</CODE> or
  +<CODE>apache-1.3-docs</CODE>), the binary distributions
  +(<CODE>apache-dist</CODE>) and even the mod_perl CVS tree
  +(<CODE>modperl</CODE>).  
  +
  +<P>
  +
  +<LI>Use the "rsync 2.0" anonymous access option.  Rsync is similar to
  +cvsup, but (in theory) more widely ported, and uses hashes rather than
  +CVS versions to watch for differences.  You can find details on rsync
  +at <A HREF="http:///samba.anu.edu.au/rsync">
  +http:///samba.anu.edu.au/rsync</A> and <A
  +HREF="http://sunsite.auc.dk/SunSITE/rsync">
  +http://sunsite.auc.dk/SunSITE/rsync</A>.  You might want to call it
  +using the following arguments:
   
  -<H2>Strategy</H2>
  +<P><UL><CODE>rsync -avz --delete --exclude incoming
  +dev.apache.org::apache-site</CODE></UL>
   
  -There are a couple different ways to mirror a remote web site:
  +<P>You can also just do a <CODE>rsync dev.apache.org::</CODE> to get a
  +list of rsync modules available.
   
  -<UL> 
  +<P>
   
   <LI>Use the <A
   HREF="http://www.apache.org/docs/mod/mod_proxy.html">proxy module</A>
  @@ -64,37 +122,34 @@
   to www.apache.org, unless the object is already in your local cache
   and is less than 24 hours old.
   
  -<LI>Use the FTP-based "mirror.pl" package, available at <A
  -HREF="http://sunsite.org.uk/packages/mirror/">http://sunsite.org.uk/packages/mirror/</A>
  -as well as at <A
  -HREF="ftp://ftp.debian.org/debian/stable/source/net/">ftp://ftp.debian.org/debian/stable/source/net/</A>.
  -If you use this, point the package at ftp://ftp.apache.org/apache/.  There is also 
  -"Wget", a package available from most GNU mirrors.
  -</UL>
  +<P>
   
  +<LI>Use the FTP-based "mirror.pl" package, available at 
  +<A HREF="http://sunsite.org.uk/packages/mirror/">
  +http://sunsite.org.uk/packages/mirror/</A>
  +as well as at 
  +<A HREF="ftp://ftp.debian.org/debian/stable/source/net/">
  +ftp://ftp.debian.org/debian/stable/source/net/</A>.  When you set this
  +up, make sure your configuration has "mode_copy=true" to ensure
  +permissions preservation.  If you use this, point the package at
  +ftp://ftp.apache.org/apache/.  There is also "Wget", a package
  +available from most GNU mirrors.
  +
  +</OL>
  +
   We do not recommend the use of Web spiders, or HTTP equivalents to the
   "mirror.pl" package, as every object needs to get a HEAD request every
   time it is checked, which is a very inefficient mechanism for seeing
  -what's been updated on an entire site.
  -
  -<P>
  -
  -There are some other requirements for serving files obtained via FTP:
  -
  -<UL>
  -  <LI>Make sure your mirror.pl script has "mode_copy=true" to ensure 
  -      permissions preservation.
  -  <LI>Set the configuration <CODE>DocumentIndex index.html index.cgi</CODE>, or
  -      <CODE>DocumentIndex index</CODE> if <CODE>Options MultiViews</CODE> is set.
  -  <LI>Please enable server-side includes, i.e. <CODE>Options Includes</CODE> or
  -      <CODE>Options IncludesNoExec</CODE>.
  -</UL>  
  +what's been updated on an entire site.  Also, the last option,
  +mirroring using FTP, may disappear at some point in the future, so we
  +strongly suggest you investigate those other mirroring options.
   
   <H2>Inform us!</H2>
   
   Once the site is set up, send mail to <A
   HREF="mailto:apache@apache.org">apache@apache.org</A> to let us know
  -it's been set up, and we'll add it to the list of mirrors.
  +it's been set up, and we'll add it to the list of mirrors.  Please be
  +patient if it takes a little while to respond.
   
   <P>