You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by cha <ch...@metrixline.com> on 2007/04/19 13:30:30 UTC
java.net.SocketTimeoutException:connect timed out
Hi All,
When am crawling it is giving me following errors in my error log :
[2007-04-17 16:45:56,343] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException:
connect timed out
[2007-04-17 16:45:56,344] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.socketConnect(Native Method)
[2007-04-17 16:45:56,345] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
[2007-04-17 16:45:56,346] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
[2007-04-17 16:45:56,346] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
[2007-04-17 16:45:56,347] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
[2007-04-17 16:45:56,347] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.Socket.connect(Socket.java:516)
[2007-04-17 16:45:56,347] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94)
[2007-04-17 16:45:56,348] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.Http.getResponse(Http.java:63)
[2007-04-17 16:45:56,349] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:208)
[2007-04-17 16:45:56,352] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144)
[2007-04-17 16:46:31,961] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException:
connect timed out
[2007-04-17 16:46:31,962] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.socketConnect(Native Method)
[2007-04-17 16:46:31,962] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
[2007-04-17 16:46:31,962] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
[2007-04-17 16:46:31,964] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
[2007-04-17 16:46:31,964] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
[2007-04-17 16:46:31,965] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
java.net.Socket.connect(Socket.java:516)
[2007-04-17 16:46:31,965] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94)
[2007-04-17 16:46:31,965] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.Http.getResponse(Http.java:63)
[2007-04-17 16:46:31,968] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.java:208)
[2007-04-17 16:46:31,968] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:? at
org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144)
[2007-04-17 16:47:07,731] [FetcherThread] ERROR
org.apache.nutch.protocol.http.Http:?
Can some one tell me how to resolve it..
I have set the fetcher.threads.fetch =2 and http.max.delay=1000 in
nutch-site.xml ..
Anything I like to set apart from this..
Pls let me know your valuable thoughts..
cheers,
cha
--
View this message in context: http://www.nabble.com/java.net.SocketTimeoutException%3Aconnect-timed-out-tf3606564.html#a10076229
Sent from the Nutch - User mailing list archive at Nabble.com.
RE: java.net.SocketTimeoutException:connect timed out
Posted by Gal Nitzan <ga...@gmail.com>.
Hi,
The meaning of this exception is that the site you crawl, did not answer for a
certain time and/or network congestion prevented the socket connection until
timeout.
Try to set the following in your nutch-site.xml
<!-- HTTP properties -->
<property><name>http.timeout</name><value>80000</value></property>
<property><name>http.max.delays</name><value>1000</value></property>
HTH,
Gal.
> -----Original Message-----
> From: cha [mailto:chandresh.rana@metrixline.com]
> Sent: Thursday, April 19, 2007 2:31 PM
> To: nutch-user@lucene.apache.org
> Subject: java.net.SocketTimeoutException:connect timed out
>
>
> Hi All,
>
> When am crawling it is giving me following errors in my error log :
>
> [2007-04-17 16:45:56,343] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException:
> connect timed out
> [2007-04-17 16:45:56,344] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.socketConnect(Native Method)
> [2007-04-17 16:45:56,345] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
> [2007-04-17 16:45:56,346] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
> [2007-04-17 16:45:56,346] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
> [2007-04-17 16:45:56,347] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> [2007-04-17 16:45:56,347] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.Socket.connect(Socket.java:516)
> [2007-04-17 16:45:56,347] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94)
> [2007-04-17 16:45:56,348] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.Http.getResponse(Http.java:63)
> [2007-04-17 16:45:56,349] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.jav
> a:208)
> [2007-04-17 16:45:56,352] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144)
> [2007-04-17 16:46:31,961] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException:
> connect timed out
> [2007-04-17 16:46:31,962] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.socketConnect(Native Method)
> [2007-04-17 16:46:31,962] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
> [2007-04-17 16:46:31,962] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
> [2007-04-17 16:46:31,964] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
> [2007-04-17 16:46:31,964] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
> [2007-04-17 16:46:31,965] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> java.net.Socket.connect(Socket.java:516)
> [2007-04-17 16:46:31,965] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94)
> [2007-04-17 16:46:31,965] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.Http.getResponse(Http.java:63)
> [2007-04-17 16:46:31,968] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.jav
> a:208)
> [2007-04-17 16:46:31,968] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:? at
> org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144)
> [2007-04-17 16:47:07,731] [FetcherThread] ERROR
> org.apache.nutch.protocol.http.Http:?
>
> Can some one tell me how to resolve it..
>
> I have set the fetcher.threads.fetch =2 and http.max.delay=1000 in
> nutch-site.xml ..
>
> Anything I like to set apart from this..
>
> Pls let me know your valuable thoughts..
>
> cheers,
> cha
> --
> View this message in context:
> http://www.nabble.com/java.net.SocketTimeoutException%3Aconnect-timed-out-
> tf3606564.html#a10076229
> Sent from the Nutch - User mailing list archive at Nabble.com.