Re: Mondo bayes_toks - millions of entries

[Michael Parker <pa...@pobox.com>]

On Nov 30, 2007, at 1:56 PM, Wes wrote:

> Well, spamd is apparently doing things far more efficiently than "sa- 
> learn
> --restore".  Tokens are loading into the DB much faster than the  
> restore,
> and postmaster is hardly ever a blip in 'top' (at least so far).  When
> running the restore, postmaster was sitting up about 60-80% CPU  
> constantly.

Learning normally can take advantage of inserting/updating tokens in  
batches.  When doing a restore it has to insert each token separately.

BTW, while the best effort was put into the postgresql support, I'm  
sure it could use help so if anyone wants to hack on it and submit  
patches I'm certain that the developers would be more than happy to  
take a look.

Michael