You are viewing a plain text version of this content. The canonical link for it is here.
Posted to cvs@httpd.apache.org by er...@apache.org on 2002/12/30 19:02:04 UTC
cvs commit: httpd-docs-1.3/htdocs/manual/misc howto.html
erikabele 2002/12/30 10:02:04
Modified: htdocs/manual/misc howto.html
Log:
Fixed links to Martijn Kosters webrobots pages.
Revision Changes Path
1.15 +2 -2 httpd-docs-1.3/htdocs/manual/misc/howto.html
Index: howto.html
===================================================================
RCS file: /home/cvs/httpd-docs-1.3/htdocs/manual/misc/howto.html,v
retrieving revision 1.14
retrieving revision 1.15
diff -u -r1.14 -r1.15
--- howto.html 8 Oct 2001 01:26:54 -0000 1.14
+++ howto.html 30 Dec 2002 18:02:04 -0000 1.15
@@ -167,7 +167,7 @@
reputation for sending hundreds/thousands of requests to each
site, often resulting in the site being overloaded. Things have
improved dramatically since then, thanks to <a
- href="http://info.webcrawler.com/mak/projects/robots/guidelines.html">
+ href="http://www.robotstxt.org/wc/guidelines.html">
Guidelines for Robot Writers</a>, but even so, some robots may
exhibit unfriendly behavior which the webmaster isn't willing
to tolerate, and will want to stop.</p>
@@ -182,7 +182,7 @@
<p>If you decide to exclude robots completely, or just limit
the areas in which they can roam, create a
<code>robots.txt</code> file; refer to the <a
- href="http://info.webcrawler.com/mak/projects/robots/robots.html">
+ href="http://www.robotstxt.org/wc/robots.html">
robot information pages</a> provided by Martijn Koster for the
syntax.</p>
<hr />