You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by sudhendra seshachala <su...@yahoo.com> on 2006/02/23 01:55:22 UTC

Nutch and HTTrack Crawler

Is there a way I could use HTTrack for crawling and nutch for just searching?
 Has any body done this before andcomparision between crawlers.
 
 How easy or tough is it to customize nutch crawler for a specific vertical ?
 I know a crude way of writing a crawler, but was wondering if any one has actually done a custom crawler..

Thanks
Sudhi




  Sudhi Seshachala
  http://sudhilogs.blogspot.com/
   


			
---------------------------------
 Yahoo! Mail
 Use Photomail to share photos without annoying attachments.

Re: Nutch and HTTrack Crawler

Posted by Stefan Groschupf <sg...@media-style.com>.

Am 23.02.2006 um 01:55 schrieb sudhendra seshachala:

> Is there a way I could use HTTrack for crawling and nutch for just  
> searching?
>  Has any body done this before andcomparision between crawlers.
I suggest take a look to lucene, since I guess it is more work  
changing nutch to your requirements than adding lucene to httrack.

>
>  How easy or tough is it to customize nutch crawler for a specific  
> vertical ?
This is a may be  to general  question but a my general answer would  
be, yes you can. :)

Stefan