You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Ned Rockson <nr...@stanford.edu> on 2007/10/16 22:16:14 UTC

Fetcher trunk running much slower

I upgraded to trunk recently and found that the Fetcher runs much
slower.  I used to use 1000 threads and get between 80 - 120
pages/second, but now with 1000 threads I'm getting closer to 10
pages/second.  I switched it to 5000 threads to see if it would make a
different, but now I'm only getting ~20 pages/second.  Is there any
reason for this?

Thanks,
Ned