You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Kristina <kr...@greatbasin.net> on 2009/08/17 00:39:02 UTC

Weirdness: SA 3.2.5 catches far less spam than 3.1.9?

Hi, all. I've looked through the list and bugzilla, and maybe I've
missed it, but I can't find anything about this problem. Basically, I
upgraded from 3.1.9 to 3.2.5 on our mail servers. This was an
out-of-the-box straight compile/install of the CPAN package. After
doing so, complaints from users started pouring in about spam. Looking
at the numbers, SA was blocking about 20% (at least) less spam than
3.1.9 did. If SA had blocked 80% of a user's total incoming mail
before, it was now blocking 50 - 60%. If it had blocked 40%, it was
now blocking 10 - 20%.

I ran lint and spamd in debug mode, and saw no errors at all about
rules being skipped or problems in the config. After going crazy for
about a week, I gave up and downgraded to 3.1.9, again, out of the box
config.

I did sa-update (for both versions) and had no problems downloading
and installing new rulesets. When I deliberately crafted a spam to hit
certain rules, it did so, but it was like 3.2.5 just didn't know
anything about the kind of spam we're getting, whereas 3.1.9 does.

Very odd. Anyone have any ideas of what I could look for, docs/FAQs I
may have missed, etc?

Thanks in advance for any pointers on where to look. This was the
darnedest thing. :-)

K.

Re: [sa] Weirdness: SA 3.2.5 catches far less spam than 3.1.9?

Posted by Charles Gregory <cg...@hwcn.org>.
On Sun, 16 Aug 2009, Kristina wrote:
> Hi, all. I've looked through the list and bugzilla, and maybe I've
> missed it, but I can't find anything about this problem. Basically, I
> upgraded from 3.1.9 to 3.2.5 on our mail servers.

When you compare the hits on a message, is there any difference in BAYES?
Maybe your database needs to be rebuilt/initialized for a new format for 
the 3.2.x?

What rules do you see triggering on 3.1.9 that are being missed on 3.2.5?

- C

Re: Weirdness: SA 3.2.5 catches far less spam than 3.1.9?

Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
> Charles Gregory wrote:
> > When you compare the hits on a message, is there any difference in BAYES?

On 17.08.09 12:23, Kristina wrote:
> Unfortunately, no: in fact, Bayes was often the only thing that was
> hitting in 3.2.5.

This may be the problem. Are the rule directories accessible/readable by the
user running SA? Either spamd or the spamassassin perl script...

-- 
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Microsoft dick is soft to do no harm

Re: Weirdness: SA 3.2.5 catches far less spam than 3.1.9?

Posted by Kristina <kr...@greatbasin.net>.
On Mon, Aug 17, 2009 at 5:17 AM, Matus UHLAR -
fantomas<uh...@fantomas.sk> wrote:

> Did you properly configure trusted_networks and internal_networks?

Yes, I double-checked that. I've read and re-read various docs on
trusted_networks and internal_networks and I'm *pretty* sure I've got
it right. :-) I also tried many different configurations of
trusted/internal in case that made a difference, but none of them
seemed to.

> Did you edit all *.pre files to load plugins you need?

Yes. I had a problem at first with the .pre files for 3.2.5 not being
installed, but corrected that. Debug showed everything loading that I
would expect to load.

> Did you change scores for some rulesets in 3.1.9? Did you comment that in
> 3.2.5?

I did change scores for some rulesets in 3.1.9, but those changes did
seem to hit just fine in 3.2.5.

Charles Gregory wrote:

> When you compare the hits on a message, is there any difference in BAYES?

Unfortunately, no: in fact, Bayes was often the only thing that was
hitting in 3.2.5.

> What rules do you see triggering on 3.1.9 that are being missed on 3.2.5?

Er. Good question. It *seemed* as though almost nothing was hitting on
3.2.5 but Bayes and a few custom rules, but I didn't run both in
parallel to get a list of specific rules that one or the other hit or
missed. (By that time, we were all "Oh, God, make the spam stop!" heh)

Since no one else seems to have had the same experience, I guess I'll
throw 3.2.5 on a non-critical server and see if I can't test the same
corpus of spam against it and 3.1.9.

Thanks!

K.

Re: Weirdness: SA 3.2.5 catches far less spam than 3.1.9?

Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
On 16.08.09 15:39, Kristina wrote:
> Hi, all. I've looked through the list and bugzilla, and maybe I've
> missed it, but I can't find anything about this problem. Basically, I
> upgraded from 3.1.9 to 3.2.5 on our mail servers. This was an
> out-of-the-box straight compile/install of the CPAN package. After
> doing so, complaints from users started pouring in about spam. Looking
> at the numbers, SA was blocking about 20% (at least) less spam than
> 3.1.9 did. If SA had blocked 80% of a user's total incoming mail
> before, it was now blocking 50 - 60%. If it had blocked 40%, it was
> now blocking 10 - 20%.

> I did sa-update (for both versions) and had no problems downloading
> and installing new rulesets. When I deliberately crafted a spam to hit
> certain rules, it did so, but it was like 3.2.5 just didn't know
> anything about the kind of spam we're getting, whereas 3.1.9 does.

Did you properly configure trusted_networks and internal_networks?
Did you edit all *.pre files to load plugins you need?
Did you change scores for some rulesets in 3.1.9? Did you comment that in
3.2.5?

3.2.5 is supposed to have lower FP and FN rate, but it mostly needs proper
configuration which may have changed and thus you may be seeing lower
efficiency...
-- 
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Spam is for losers who can't get business any other way.