You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Ibrahim Alkharashi <kh...@kacst.edu.sa> on 2011/02/20 05:41:45 UTC

crawling on cluster

Hello everybody

We have a cluster of five nodes, is there a way of telling that slaves
are crawling after issuing the command bin/nutch crawl urls -dir ...

Ibrahim

Re: crawling on cluster

Posted by Thomas Anderson <t....@gmail.com>.

If command is issued with nohup, following link seems to provide a way
to check crawling statistics.

http://wiki.apache.org/nutch/MonitoringNutchCrawls

On Sun, Feb 20, 2011 at 12:41 PM, Ibrahim Alkharashi
<kh...@kacst.edu.sa> wrote:
>
> Hello everybody
>
> We have a cluster of five nodes, is there a way of telling that slaves
> are crawling after issuing the command bin/nutch crawl urls -dir ...
>
> Ibrahim
>
>
>