[users@httpd] Automated requests originating from planet-lab domains

[Boyle Owen <Ow...@swx.com>]

Greetings,

There have been several posts recently on the subject of how to block out robots which make repeated, high-frequency requests even to URLs disallowed by robots.txt. 

Has anyone been experiencing attacks like this which have the following signature:

- source IP variable (chosen exponentially from a range of around 150 IPs)
- user agent like "Linuxx", "NETIKUS", "FileDownloader" etc.
- Referer is a spoofed bona fide web-page (often in the same geographical domain as the target)
- sending a GET request to the source IP address often returns a page like this: http://202.79.220.49/

Rgds,
Owen Boyle
Disclaimer: Any disclaimer attached to this message may be ignored. 

Diese E-mail ist eine private und persönliche Kommunikation. Sie hat keinen Bezug zur Börsen- bzw. Geschäftstätigkeit der SWX Gruppe. This e-mail is of a private and personal nature. It is not related to the exchange or business activities of the SWX Group. Le présent e-mail est un message privé et personnel, sans rapport avec l'activité boursière du Groupe SWX.
 
 
This message is for the named person's use only. It may contain confidential, proprietary or legally privileged information. No confidentiality or privilege is waived or lost by any mistransmission. If you receive this message in error, please notify the sender urgently and then immediately delete the message and any copies of it from your system. Please also immediately destroy any hardcopies of the message. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. The sender's company reserves the right to monitor all e-mail communications through their networks. Any views expressed in this message are those of the individual sender, except where the message states otherwise and the sender is authorised to state them to be the views of the sender's company.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org