You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Nuther <nu...@proservice.ge> on 2007/04/12 09:05:53 UTC

Re: Have anybody thought of replacing CrawlDb with any kind of Rational DB?

Hi, wangxu.

You wrote 13 апреля 2007 г., 1:03:31:

> Have anybody thought of replacing CrawlDb with any kind of Rational
> DB,mysql,for example?

> Crawldb is so difficult to manipulate.
> I often have the requirements to edit several entries in crawdb;
> But that would cost too much waiting for the mapReduce.
You think MySQL would give you higher speed? :)
Just try DataPark Search for large number of urls :)
and you will see the difference ;)