You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Ben Halsted <bh...@gmail.com> on 2005/11/21 19:46:12 UTC

merging auto-crawls

Hi All,

I've tried at nutch-user with no success. Can someone help me with the below
questions?

Thanks!

---------- Forwarded message ----------
From: Ben Halsted <bh...@gmail.com>
Date: Nov 18, 2005 10:44 PM
Subject: merging auto-crawls
To: nutch-user@lucene.apache.org

Hello,

(Using the latest compiled SVN mapred branch)

I've modified the auto-crawl to always use a pre-existing crawldb. If I run
it multiple times I get multiple linkdb, segments, indexes, and index
directories.

Is it possible to merge the results using the bin/nutch comamnds?

Thanks!
Ben