You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by EM <em...@cpuedge.com> on 2005/08/05 22:20:28 UTC

fetching redirect bug?

Suppose we have to fetch 3 pages. 

Page A is http://something/login.php 
Page B is http://yyy/rrr/ which, when fetched, redirects to page A
Page C is http://yyy/ttt/ which, when fetched, redirects to page A

When fetching A, B, C the fetcher will fetch 
A
B
A
C
A

Is there any way to prevent the refetching of page A?