You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Mike Markzon <mm...@yahoo.com> on 2006/01/16 05:36:15 UTC

Do I understand how this is going to work?

I just want to make sure I understand how all this
crawling/fetching/etc works.

I have 2 sites that I need to be able to access
through one search.

Will I initially do a crawl with the root of both
sites in the text? 
Then I should keep generating segments and re-fetching
and updating the db until I can dump the db and see
that everything has been fetched?

If I script a nightly generate/fetch/update how can I
guarantee that any new pages on either site are found
and indexed?  Not being able to do that is a deal
breaker in using this.
Thanks!
Mike

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com