Re: Nutch doesn't crawl all seed

[Imtiaz Shakil Siddique <sh...@gmail.com>]

As far as I know,

If you are crawling using the crawl script found inside
$nutch_home/bin/crawl then it will generate top 50000 links to start
fetching and parsing thus many URLs inside your seed file won't be crawled
in the first iteration.

You should also check regex-urlfilter.txt inside conf directory to make
sure that all of your seed urls are injected or not.

Hope it helps.