You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Sunnyvale Fl <su...@gmail.com> on 2006/01/27 02:03:43 UTC

updatedb

I am a bit confused as to recreating the WebDB from segments (using Nutch
0.7.1).  Let's say I have 20 segments, and I think my WebDB is corrupted so
I create a new db using nutch admin db - create.  Then I do updatedb from
the 20 segments.  How does updatedb create the link structure from
segments?  I am under the impression that segments contain the actual page
content and metatags around a page, but not the link structure.  No?
Thanks!

Re: updatedb

Posted by Stefan Groschupf <sg...@media-style.com>.
Yes this mechanism will work, since parse data contains also the  
parsed outgoing links of a page (url) so you can rebuild the complete  
web graph.

Am 27.01.2006 um 02:03 schrieb Sunnyvale Fl:

> I am a bit confused as to recreating the WebDB from segments (using  
> Nutch
> 0.7.1).  Let's say I have 20 segments, and I think my WebDB is  
> corrupted so
> I create a new db using nutch admin db - create.  Then I do  
> updatedb from
> the 20 segments.  How does updatedb create the link structure from
> segments?  I am under the impression that segments contain the  
> actual page
> content and metatags around a page, but not the link structure.  No?
> Thanks!

---------------------------------------------------------------
company:        http://www.media-style.com
forum:        http://www.text-mining.org
blog:            http://www.find23.net