You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Chetan Sahasrabudhe <Ch...@KPITCummins.com> on 2005/04/20 09:26:40 UTC
What does segments stand for ?
What does segments stand for ?
As per my understanding for every crawl nutch creates a separate segment.
If I want to update values for perticular URL in x segment, then how do I decide what segment folder to use for applying IndexSegment ?
Regards
Chetan
Regards
Chetan
RE: What does segments stand for ?
Posted by Chirag Chaman <de...@filangy.com>.
Chetan,
I assuming you're looking to update a document within a segment. The way
Nutch works, once a segment iscreated, it's not meant to be updated. So, if
you were to get the same URL again, it will be in a new segment.
Periodically, you merge multiple segments which removes the duplicates.
Most medium to large installs have their own way to deal with this situation
given their needs.
Regards,
CC
-----Original Message-----
From: Chetan Sahasrabudhe [mailto:ChetanS@KPITCummins.com]
Sent: Wednesday, April 20, 2005 3:27 AM
To: nutch-user@incubator.apache.org
Subject: What does segments stand for ?
What does segments stand for ?
As per my understanding for every crawl nutch creates a separate segment.
If I want to update values for perticular URL in x segment, then how do I
decide what segment folder to use for applying IndexSegment ?
Regards
Chetan
Regards
Chetan