You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by luck <lu...@skygate.de> on 2007/08/22 16:18:10 UTC

nutch-0.9 endless loop on fetching redirect

I want to crawl imove-germany.de domain and when nutch fetches the redirect
from
http://www.imove-germany.de/konferenz2007 to
http://domains.euroforum.com/imove/default.asp
it loops on "fetching http://domains.euroforum.com/imove/default.asp".
I tried to solve the problem, but i can't find the reason for the endless
loop.

I added some more Debug outputs in org.apache.nutch.fetcher.Fetcher and so i
found out that
input.next(key,datum) in org.apache.nutch.fetcher.Fetcher always returns the
same URL on every loop.

Can anybody help? Or has anybody also a problem with redirects?


-- 
View this message in context: http://www.nabble.com/nutch-0.9-endless-loop-on-fetching-redirect-tf4311900.html#a12275658
Sent from the Nutch - User mailing list archive at Nabble.com.