You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by og...@yahoo.com on 2005/05/01 19:03:30 UTC

OT: Looksmar,: fix your User-Agent

Hello,

I remember seeing somebody from Looksmart post here once, so here is
something for Looksmart.  It looks like Looksmart is using Nutch, but
with a default User Agent name and Nutch's old, default email address:


64.242.88.10 - - [01/May/2005:12:22:04 -0400] "GET / HTTP/1.0" 302 266
"-" "NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net)"

$ nslookup  64.242.88.10

Non-authoritative answer:
10.88.242.64.in-addr.arpa       name = sv-crawl.looksmart.com.

Otis
____________________________________________________________________
Simpy -- simpy.com -- tags, social bookmarks, personal search engine