You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Matus UHLAR - fantomas <uh...@fantomas.sk> on 2025/01/15 09:21:41 UTC
Re: mailspike dot net Minus 1?
Hello,
On 21.09.24 12:51, joe a wrote:
>Noticed some obvious spam slipping in due in great part to this:
>
> * -1.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
> * [209.85.166.199 listed in wl.mailspike.net]
>
>Not a big deal for my low volume SOHO, but it's annoying.
>
>Has that check become unreliable? Sure, I can skip that check (I think) or alter the score, but any other thoughts?
FYI:
199.166.85.209.in-addr.arpa domain name pointer mail-il1-f199.google.com.
I too have recently received multiple e-mails where sending server was in
MSPIKE_H2, pushing them under required_score limit.
many of them were in google and microsoft networks:
* -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
* [40.92.58.106 listed in wl.mailspike.net]
* -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
* [209.85.222.65 listed in wl.mailspike.net]
* -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
* [209.85.218.47 listed in wl.mailspike.net]
It seems that RCVD_IN_MSPIKE_H2 is the only one that produces significant
score:
50_scores.cf: score RCVD_IN_MSPIKE_ZBI 2.7
50_scores.cf: score RCVD_IN_MSPIKE_L5 2.5
50_scores.cf: score RCVD_IN_MSPIKE_L4 1.7
50_scores.cf: score RCVD_IN_MSPIKE_L3 0.9
50_scores.cf: score RCVD_IN_MSPIKE_H3 -0.01
50_scores.cf: score RCVD_IN_MSPIKE_H4 -0.01
50_scores.cf: score RCVD_IN_MSPIKE_H5 -1.0
50_scores.cf: score RCVD_IN_MSPIKE_BL 0.01
50_scores.cf: score RCVD_IN_MSPIKE_WL -0.01
72_scores.cf:score RCVD_IN_MSPIKE_BL 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H2 0.001 -1.794 0.001 -1.794
72_scores.cf:score RCVD_IN_MSPIKE_H3 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H4 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H5 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L2 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L3 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L4 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L5 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_WL 0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_ZBI 0.001 0.001 0.001 0.001
Does it make sense to use this WL with this score?
--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Saving Private Ryan...
Private Ryan exists. Overwrite? (Y/N)
Re: mailspike dot net Minus 1?
Posted by John Hardin <jh...@impsec.org>.
On Sun, 19 Jan 2025, Matus UHLAR - fantomas wrote:
> should I assume that RuleQA works with different corpus than masscheck?
The following is my understanding absent having ever done a deep dive
through the scoring code...
Nope. masscheck runs the current ruleset against the contributors' ham and
spam corpora and records which rules hit which message. The results are
uploaded to the RuleQA host where those results are analysed and scores
are generated.
They are different phases in the same process, and we're pretty loose
about using the terms interchangably to refer to the entire thing.
>> On 15.01.25 09:23, Bill Cole wrote:
>> It is worth noting that the 72_scores.cf file is what the RuleQA
>> process produces.
>
> 50_scores.cf should be generated by mass-checking, where H2 generated
> no score (why?)
Bill was correct. 72_scores.cf is generated by the masscheck/ruleqa
process. The masscheck/ruleqa process does not evaluate or generate scores
for all rules, though.
50_scores.cf is fixed scores set either manually or (historically) from a
different analysis process that is run *very* infrequently. It is not
generated from the masscheck/ruleqa process.
There is no score for RCVD_IN_MSPIKE_H2 in 50_scores.cf. There are scores
for the other MSPIKE rules there and the ones appearing there do NOT
appear in 72_scores.cf so it looks like they are not being evaluated for
scoring. The score for _H2 was apparently accidentally removed by this
commit:
https://svn.apache.org/viewvc/spamassassin/trunk/rules/50_scores.cf?r1=1213550&r2=1213551&diff_format=h
I've added a score for RCVD_IN_MSPIKE_H2 back into 50_scores.cf to see
whether that affects things. It looks like that is the only MSPIKE rule
that masscheck is generating scores for and I can't really see why apart
from it not appearing in 50_scores.cf, and at the moment I don't want to
go spelunking in the code to verify that's the override...
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
Politicians never accuse you of "greed" for wanting other people's
money, only for wanting to keep your own money. -- Joseph Sobran
-----------------------------------------------------------------------
4 days until John Moses Browning's 170th Birthday
Re: mailspike dot net Minus 1?
Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
>On 2025-01-15 at 04:21:41 UTC-0500 (Wed, 15 Jan 2025 10:21:41 +0100)
>Matus UHLAR - fantomas <uh...@fantomas.sk>
>is rumored to have said:
>>It seems that RCVD_IN_MSPIKE_H2 is the only one that produces
>>significant score:
>>
>>50_scores.cf: score RCVD_IN_MSPIKE_ZBI 2.7
>>50_scores.cf: score RCVD_IN_MSPIKE_L5 2.5
>>50_scores.cf: score RCVD_IN_MSPIKE_L4 1.7
>>50_scores.cf: score RCVD_IN_MSPIKE_L3 0.9
>>50_scores.cf: score RCVD_IN_MSPIKE_H3 -0.01
>>50_scores.cf: score RCVD_IN_MSPIKE_H4 -0.01
>>50_scores.cf: score RCVD_IN_MSPIKE_H5 -1.0
>>50_scores.cf: score RCVD_IN_MSPIKE_BL 0.01
>>50_scores.cf: score RCVD_IN_MSPIKE_WL -0.01
>>72_scores.cf:score RCVD_IN_MSPIKE_BL 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H2 0.001 -1.794 0.001 -1.794
>>72_scores.cf:score RCVD_IN_MSPIKE_H3 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H4 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H5 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L2 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L3 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L4 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L5 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_WL 0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_ZBI 0.001 0.001 0.001 0.001
On 15.01.25 09:23, Bill Cole wrote:
>It is worth noting that the 72_scores.cf file is what the RuleQA
>process produces. I haven't dug into the details, but it looks like
>Mailspike is ONLY really useful at the H2 level.
that's possible, but according to https://mailspike.io/ip_verify/usage
H2 is supposed to be indication of "Possible legit sender"
50_scores.cf should be generated by mass-checking, where H2 generated no
score (why?)
and yet, H2 has more significant score that what mass-check generated
L5 (excellent reputation) which should be stronger indicator of hamminess.
>>Does it make sense to use this WL with this score?
>
>That has to be a local question.
This is what I'm curious about. Of course I can locally increase the score
locally.
>For the people going to the trouble of submitting human-classified ham
>and spam results to RuleQA, RCVD_IN_MSPIKE_H2 was a fairly strong
>indicator of non-spam. So it makes sense IF your mailstream looks a
>lot like that of the submitters. Sadly, mailstreams vary a great
>deal, so no individual site is likely to match the non-random sample
>that we have access to.
should I assume that RuleQA works with different corpus than masscheck?
>I don't think the listing of behemoth sources as "good-ish" is wrong
>per se, because many sites can show that they get more ham from GMail
>than spam. MS is a somewhat different story, because they try to
>segregate their suspect mail to a subset of output points. If your
>mail does not include much GMail ham, it may make sense to set the
>scores locally. E.g. I have:
>
>/etc/mail/spamassassin/local.cf:score RCVD_IN_MSPIKE_H2 0.2
>/etc/mail/spamassassin/local.cf:score RCVD_IN_MSPIKE_H3 0.1
>
>Those are based on careful analysis a few years ago, so I can't even
>be sure that they make sense for me today, but they certainly are not
>causing visible trouble,
--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Christian Science Programming: "Let God Debug It!".
Re: mailspike dot net Minus 1?
Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2025-01-15 at 04:21:41 UTC-0500 (Wed, 15 Jan 2025 10:21:41 +0100)
Matus UHLAR - fantomas <uh...@fantomas.sk>
is rumored to have said:
> Hello,
>
> On 21.09.24 12:51, joe a wrote:
>> Noticed some obvious spam slipping in due in great part to this:
>>
>> * -1.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>> * [209.85.166.199 listed in wl.mailspike.net]
>>
>> Not a big deal for my low volume SOHO, but it's annoying.
>>
>> Has that check become unreliable? Sure, I can skip that check (I
>> think) or alter the score, but any other thoughts?
>
> FYI:
> 199.166.85.209.in-addr.arpa domain name pointer
> mail-il1-f199.google.com.
Which demonstrates the problem. Their H2 list includes highly mixed
sources.
>
> I too have recently received multiple e-mails where sending server was
> in MSPIKE_H2, pushing them under required_score limit.
>
> many of them were in google and microsoft networks:
>
> * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
> * [40.92.58.106 listed in wl.mailspike.net]
>
> * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
> * [209.85.222.65 listed in wl.mailspike.net]
>
> * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
> * [209.85.218.47 listed in wl.mailspike.net]
>
>
> It seems that RCVD_IN_MSPIKE_H2 is the only one that produces
> significant score:
>
> 50_scores.cf: score RCVD_IN_MSPIKE_ZBI 2.7
> 50_scores.cf: score RCVD_IN_MSPIKE_L5 2.5
> 50_scores.cf: score RCVD_IN_MSPIKE_L4 1.7
> 50_scores.cf: score RCVD_IN_MSPIKE_L3 0.9
> 50_scores.cf: score RCVD_IN_MSPIKE_H3 -0.01
> 50_scores.cf: score RCVD_IN_MSPIKE_H4 -0.01
> 50_scores.cf: score RCVD_IN_MSPIKE_H5 -1.0
> 50_scores.cf: score RCVD_IN_MSPIKE_BL 0.01
> 50_scores.cf: score RCVD_IN_MSPIKE_WL -0.01
> 72_scores.cf:score RCVD_IN_MSPIKE_BL 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H2 0.001 -1.794
> 0.001 -1.794
> 72_scores.cf:score RCVD_IN_MSPIKE_H3 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H4 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H5 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L2 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L3 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L4 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L5 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_WL 0.001 0.001
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_ZBI 0.001 0.001
> 0.001 0.001
It is worth noting that the 72_scores.cf file is what the RuleQA process
produces. I haven't dug into the details, but it looks like Mailspike is
ONLY really useful at the H2 level.
> Does it make sense to use this WL with this score?
That has to be a local question.
For the people going to the trouble of submitting human-classified ham
and spam results to RuleQA, RCVD_IN_MSPIKE_H2 was a fairly strong
indicator of non-spam. So it makes sense IF your mailstream looks a lot
like that of the submitters. Sadly, mailstreams vary a great deal, so
no individual site is likely to match the non-random sample that we have
access to.
I don't think the listing of behemoth sources as "good-ish" is wrong per
se, because many sites can show that they get more ham from GMail than
spam. MS is a somewhat different story, because they try to segregate
their suspect mail to a subset of output points. If your mail does not
include much GMail ham, it may make sense to set the scores locally.
E.g. I have:
/etc/mail/spamassassin/local.cf:score RCVD_IN_MSPIKE_H2 0.2
/etc/mail/spamassassin/local.cf:score RCVD_IN_MSPIKE_H3 0.1
Those are based on careful analysis a few years ago, so I can't even be
sure that they make sense for me today, but they certainly are not
causing visible trouble,
--
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo@toad.social and many *@billmail.scconsult.com
addresses)
Not Currently Available For Hire