You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by devang pandey <de...@gmail.com> on 2013/07/10 07:13:48 UTC

nutch crawling same page manytimes

I am crawling a website with nutch 1.2 . Problem that I am facing is :that
website generates different urls for same page every time you open it
.Becausee of this issue nutch is crawling same page again and again .
Please suggest me how to resolve this issue.