You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Berlin Brown <be...@gmail.com> on 2006/04/16 17:05:44 UTC

Interesting sites crawled

I am curious; there are a lot more dynamic sites out there with some
intereting links.  What are some of the more interesting public sites
that you have crawled.

For example; I have been crawling reddit.com and digg.com recently and
have gotten back some interesting search results.  I thought crawling
wikipedia and having an searchable index of words and keyphrases.