You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Christophe Noel <ch...@cetic.be> on 2005/11/21 14:22:32 UTC
fetcher.thread.per.host not working ??
Hello,
There is something wrong with thread per host...
Only one thread should only fetch one host at the same time, so why do i
get these 2 connect time out (15 sec) at 13:15 and 15 seconds ?!!!
This is not normal and so I get about 1000 errors when I crawl about
1400 pages...
*Here is the log :*
051121 131515 17 fetch of
http://www.forum.math.ulg.ac.be/doc/WMC.html?SESSID=b03ef782492f97b0507f7281ce8088cb
failed with: java.lang.Exception: java.net.SocketTimeoutException:
connect timed out
051121 131515 17 fetching
http://ssel.vub.ac.be/viewcvs/viewcvs.py/cvs/cocompose/MakeAllDist.sh?rev=1.2&view=log
051121 131516 70 fetch of
http://www.forum.math.ulg.ac.be/doc/WMC.html?SESSID=5e078d23b09e35fa3cb57563f3edac93
failed with: java.lang.Exception: java.net.SocketTimeoutException:
connect timed out
051121 131516 70 fetching
http://www.forum.math.ulg.ac.be/viewthread.html?SESSID=a514546281e260e97b0d4ffef7d3fe67&id=18614
051121 131516 47 fetching
http://alexandrie.droit.fundp.ac.be/Record.htm?
idlist=287&record=19145278280919634500
051121 131516 57 fetch of
http://www.forum.math.ulg.ac.be/viewsection.html?SESSID=7384e568d8d3c2fd5b8cfacc11baa9a9&id=2
failed with: java.lang.Exception: java.net.SocketTimeoutException:
connect timed out
051121 131516 57 fetching
http://www.bib.ucl.ac.be/cgi-bin/chameleon?search=KEYWORD&function=INITREQ&SourceScreen=INITREQ&sessionid=256721&skin=gandalf&conf=.%2fchameleon.conf&lng=fr-be&itemu1=1003&u1=1003&t1=Wanko%20Nankam,%20Caroline&pos=1&prevpos=1&beginsrch=1
051121 131516 17 fetching
http://www.forum.math.ulg.ac.be/viewsection.html?SESSID=08f49a63e3045f6481cba10cbe996eaa
051121 131516 42 fetching
http://www.iagr.ucl.ac.be/planning/processus-staff/
051121 131516 42 fetching http://www.iagr.ucl.ac.be/staff/
051121 131516 65 fetch of
http://www.forum2.math.ulg.ac.be/viewsection.html?SESSID=fa1e4296b3df0eed81bbc60b98a371f3&id=11
failed with: java.lang.Exception: java.net.SocketTimeoutException: connect
timed out