You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Chetan Sahasrabudhe <Ch...@KPITCummins.com> on 2005/04/20 09:26:40 UTC

What does segments stand for ?

What does segments stand for ?
As per my understanding for every crawl nutch creates a separate segment.
If I want to update values for perticular URL in x segment, then how do I decide what segment folder to use for applying IndexSegment ?
Regards 
Chetan 


Regards 
Chetan 

RE: What does segments stand for ?

Posted by Chirag Chaman <de...@filangy.com>.
Chetan,

I assuming you're looking to update a document within a segment. The way
Nutch works, once a segment iscreated, it's not meant to be updated. So, if
you were to get the same URL again, it will be in a new segment.
Periodically, you merge multiple segments which removes the duplicates.

Most medium to large installs have their own way to deal with this situation
given their needs.

Regards,
CC
 

-----Original Message-----
From: Chetan Sahasrabudhe [mailto:ChetanS@KPITCummins.com] 
Sent: Wednesday, April 20, 2005 3:27 AM
To: nutch-user@incubator.apache.org
Subject: What does segments stand for ?

What does segments stand for ?
As per my understanding for every crawl nutch creates a separate segment.
If I want to update values for perticular URL in x segment, then how do I
decide what segment folder to use for applying IndexSegment ?
Regards
Chetan 


Regards 
Chetan