You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Fuad Efendi <fu...@efendi.ca> on 2005/08/29 01:49:49 UTC

For day-to-day usage, which commands should I execute?

I created initial WebDB, Segments, Index; I executed bin/nutch crawl.

For day-to-day usage, which commands should I execute?

generate db segments
fetch -noParsing -threads 1 segments\$s
parse segments\$s
updatedb db segments\$s
index segments\$s

Am I right, is one cycle (one segment) enough for existing WebDB?

Thanks,
Fuad

RE: For day-to-day usage, which commands should I execute?

Posted by Fuad Efendi <fu...@efendi.ca>.
Just kidding, tried to execute Parse separately...

generate db segments
fetch -threads 1 segments\$s
updatedb db segments\$s
index segments\$s

Is that enough for simple Refresh/Update of a search engine? Executed
only once... One new segment, and "index segments"... 


-----Original Message-----
From: EM [mailto:emilijan@cpuedge.com] 
Sent: Sunday, August 28, 2005 8:21 PM
To: nutch-user@lucene.apache.org
Subject: RE: For day-to-day usage, which commands should I execute?


Why fetch -noParsing?


-----Original Message-----
From: Fuad Efendi [mailto:fuad@efendi.ca] 
Sent: Sunday, August 28, 2005 7:50 PM
To: nutch-user@lucene.apache.org
Subject: For day-to-day usage, which commands should I execute?

I created initial WebDB, Segments, Index; I executed bin/nutch crawl.

For day-to-day usage, which commands should I execute?

generate db segments
fetch -noParsing -threads 1 segments\$s
parse segments\$s
updatedb db segments\$s
index segments\$s

Am I right, is one cycle (one segment) enough for existing WebDB?

Thanks,
Fuad

RE: For day-to-day usage, which commands should I execute?

Posted by EM <em...@cpuedge.com>.
Why fetch -noParsing?


-----Original Message-----
From: Fuad Efendi [mailto:fuad@efendi.ca] 
Sent: Sunday, August 28, 2005 7:50 PM
To: nutch-user@lucene.apache.org
Subject: For day-to-day usage, which commands should I execute?

I created initial WebDB, Segments, Index; I executed bin/nutch crawl.

For day-to-day usage, which commands should I execute?

generate db segments
fetch -noParsing -threads 1 segments\$s
parse segments\$s
updatedb db segments\$s
index segments\$s

Am I right, is one cycle (one segment) enough for existing WebDB?

Thanks,
Fuad