Re: SpamAssassin Scalability issues in Enterprise environments......

[Justin Mason <jm...@jmason.org>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


Martin Hepworth writes:
> Forest
> 
> depends on which machines update the bayes DB. From what I understand 
> the current idea is to nfs mount the bayes DB's readonly so only one 
> system updates it (the one where it's on a local filesystem).
> 
> The problem seems to be with file locking on writes.

The problem is more file writes in general.  Locking is implemented
in an NFS-safe way, but DB writes over NFS are *extremely* slow
and heavy on the network.

I'd suggest even keeping 1 machine as the "master" bayes DB, do sa-learns
there by hand, and copy out DBs onto the "slave" servers which do
the scanning.  Each "slave" has a copy of the bayes DB on their
local disk, which is overwritten periodically by the master.

- --j.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
Comment: Exmh CVS

iD8DBQFARijNQTcbUG5Y7woRAinnAKDfl33zRco2oUPgczsf/nJ0gkc0ewCfdJeK
m+xIyu0qhFWWKuWw8+Y3/zQ=
=Jf/T
-----END PGP SIGNATURE-----

Re: SpamAssassin Scalability issues in Enterprise environments......

[Theo Van Dinter <fe...@kluge.net>]

On Wed, Mar 03, 2004 at 06:46:30PM -0800, Loren Wilton wrote:
> Does Bayes have a "learn to log" option where it can spool all the messages
> an auto-learn has decided to learn?

Yes. there's a learn to journal option.

-- 
Randomly Generated Tagline:
"The Pre-1985 Video Game Character Test was created by RavenBlack. It is
 entirely in fun. Don't think you have special powers just because the test
 tells you so. It is not serious, and not to be taken internally. So don't."
         - http://blog.ravenblack.net/quiz/videogame.pl

Re: SpamAssassin Scalability issues in Enterprise environments......

[Loren Wilton <lw...@earthlink.net>]

> I'd suggest even keeping 1 machine as the "master" bayes DB, do sa-learns
> there by hand, and copy out DBs onto the "slave" servers which do
> the scanning.  Each "slave" has a copy of the bayes DB on their
> local disk, which is overwritten periodically by the master.

Which brings up an interesting thought.

Does Bayes have a "learn to log" option where it can spool all the messages
an auto-learn has decided to learn?

If it did, each system could "autolearn" to a local log, and a cron script
could suck them up every so often, cat them together, and do a dedicated
update of the Bayes db, then redeploy the updated version.

I'd think with that the only place you will take a hit will be doing the
actual db update, which probably will shut down Bayes for a few moments
during the file switch.

You could do the entire learn process on a dedicated small machine that
wasn't even part of the actual mail filtering system, but was just a db
updater and redeployer.

        Loren