You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Mike Markzon <mm...@yahoo.com> on 2006/01/16 05:36:15 UTC
Do I understand how this is going to work?
I just want to make sure I understand how all this
crawling/fetching/etc works.
I have 2 sites that I need to be able to access
through one search.
Will I initially do a crawl with the root of both
sites in the text?
Then I should keep generating segments and re-fetching
and updating the db until I can dump the db and see
that everything has been fetched?
If I script a nightly generate/fetch/update how can I
guarantee that any new pages on either site are found
and indexed? Not being able to do that is a deal
breaker in using this.
Thanks!
Mike
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com