You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by eyal edri <ey...@gmail.com> on 2007/11/14 15:37:36 UTC

java.net.SocketException: Connection reset when using too many threads

Hello,

i've noticed that when i use threads (more than 1/2) on my PC when running
fetch,
a lot of sites fail with "connection reset" or "read time out".. exceptions,
and when i reduce the number of threads the amount of errors reduces as
well.

I understand that the system must have a limit of threads it can handle,
my questions is:

   1.  how can you know the optimal number of threads to use before
   getting exceptions
   2. is there a way to config OS or nutch to work with more threads
   without getting exceptions?

thanks!

-- 
Eyal Edri