You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Emre Çelikten <em...@celikten.name> on 2012/07/09 17:13:01 UTC

Running generate, fetch, parse and update steps per host

Hello,

I have a handful of seed URLs with external links ignored. Is it 
possible to run generate, fetch, parse and update steps per host? So 
that faster hosts that have a lower delay between consecutive fetches go 
into the next depth faster.

I am trying to achieve something like this: 
http://lucene.472066.n3.nabble.com/Build-a-pipeline-using-nutch-td3742730.html

Best,

Emre