You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by eyal edri <ey...@gmail.com> on 2007/11/14 15:37:36 UTC
java.net.SocketException: Connection reset when using too many threads
Hello,
i've noticed that when i use threads (more than 1/2) on my PC when running
fetch,
a lot of sites fail with "connection reset" or "read time out".. exceptions,
and when i reduce the number of threads the amount of errors reduces as
well.
I understand that the system must have a limit of threads it can handle,
my questions is:
1. how can you know the optimal number of threads to use before
getting exceptions
2. is there a way to config OS or nutch to work with more threads
without getting exceptions?
thanks!
--
Eyal Edri