You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by mina <ta...@gmail.com> on 2011/12/06 16:01:45 UTC

best number of threads per host

hi, i crawl 4 sites with:

topN=1000000
depth=3
nutch1.3
 
what is the best number of threads per host? i want crawl sites very fast.

--
View this message in context: http://lucene.472066.n3.nabble.com/best-number-of-threads-per-host-tp3564541p3564541.html
Sent from the Nutch - User mailing list archive at Nabble.com.

Re: best number of threads per host

Posted by Markus Jelsma <ma...@openindex.io>.

1 thread, if you want more then consult the webmaster.

> hi, i crawl 4 sites with:
> 
> topN=1000000
> depth=3
> nutch1.3
> 
> what is the best number of threads per host? i want crawl sites very fast.
> 
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/best-number-of-threads-per-host-tp35645
> 41p3564541.html Sent from the Nutch - User mailing list archive at
> Nabble.com.