You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Jacob Brunson <ja...@gmail.com> on 2006/05/06 00:26:31 UTC
Creating and updating indexes
I'm using the latest checkout
(http://svn.apache.org/repos/asf/lucene/nutch/trunk rev 400163) with
Java 1.5.
I've been trying to follow the tutorial for whole web crawling which
is found at http://lucene.apache.org/nutch/tutorial8.html#Whole-web+Crawling
For the most part, I get through the tutorial just fine, although I
did have to look at the latest command line options for the
invertlinks and index commands to make it work.
Now if I want to update my index, I do: generate, fetch, updatedb,
invertlinks, index. But I can't run the index command a second time
because it complains that the indexes directory already exists. How
am I suppose to update the index?
Also, in other tutorials I see a dedup command. What is this used for
and when should I use it?
Thank you so much for your help.
--Jacob