You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Emre Çelikten <em...@celikten.name> on 2012/07/09 17:13:01 UTC
Running generate, fetch, parse and update steps per host
Hello,
I have a handful of seed URLs with external links ignored. Is it
possible to run generate, fetch, parse and update steps per host? So
that faster hosts that have a lower delay between consecutive fetches go
into the next depth faster.
I am trying to achieve something like this:
http://lucene.472066.n3.nabble.com/Build-a-pipeline-using-nutch-td3742730.html
Best,
Emre