You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Matus UHLAR - fantomas <uh...@fantomas.sk> on 2025/01/15 09:21:41 UTC

Re: mailspike dot net Minus 1?

Hello,

On 21.09.24 12:51, joe a wrote:
>Noticed some obvious spam slipping in due in great part to this:
>
>	* -1.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>	*      [209.85.166.199 listed in wl.mailspike.net]
>
>Not a big deal for my low volume SOHO, but it's annoying.
>
>Has that check become unreliable?  Sure, I can skip that check (I think) or alter the score, but any other thoughts?

FYI:
199.166.85.209.in-addr.arpa domain name pointer mail-il1-f199.google.com.


I too have recently received multiple e-mails where sending server was in 
MSPIKE_H2, pushing them under required_score limit.

many of them were in google and microsoft networks:

         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
         *      [40.92.58.106 listed in wl.mailspike.net]

         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
         *      [209.85.222.65 listed in wl.mailspike.net]

         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
         *      [209.85.218.47 listed in wl.mailspike.net]


It seems that RCVD_IN_MSPIKE_H2 is the only one that produces significant 
score:

50_scores.cf:  score RCVD_IN_MSPIKE_ZBI     2.7
50_scores.cf:  score RCVD_IN_MSPIKE_L5      2.5
50_scores.cf:  score RCVD_IN_MSPIKE_L4      1.7
50_scores.cf:  score RCVD_IN_MSPIKE_L3      0.9
50_scores.cf:  score RCVD_IN_MSPIKE_H3      -0.01
50_scores.cf:  score RCVD_IN_MSPIKE_H4      -0.01
50_scores.cf:  score RCVD_IN_MSPIKE_H5      -1.0
50_scores.cf:  score RCVD_IN_MSPIKE_BL      0.01
50_scores.cf:  score RCVD_IN_MSPIKE_WL      -0.01
72_scores.cf:score RCVD_IN_MSPIKE_BL                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H2                     0.001 -1.794 0.001 -1.794
72_scores.cf:score RCVD_IN_MSPIKE_H3                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H4                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_H5                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L2                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L3                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L4                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_L5                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_WL                     0.001 0.001 0.001 0.001
72_scores.cf:score RCVD_IN_MSPIKE_ZBI                    0.001 0.001 0.001 0.001


Does it make sense to use this WL with this score?



-- 
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Saving Private Ryan...
Private Ryan exists. Overwrite? (Y/N)

Re: mailspike dot net Minus 1?

Posted by John Hardin <jh...@impsec.org>.
On Sun, 19 Jan 2025, Matus UHLAR - fantomas wrote:

> should I assume that RuleQA works with different corpus than masscheck?

The following is my understanding absent having ever done a deep dive 
through the scoring code...

Nope. masscheck runs the current ruleset against the contributors' ham and 
spam corpora and records which rules hit which message. The results are 
uploaded to the RuleQA host where those results are analysed and scores 
are generated.

They are different phases in the same process, and we're pretty loose 
about using the terms interchangably to refer to the entire thing.

>> On 15.01.25 09:23, Bill Cole wrote:
>> It is worth noting that the 72_scores.cf file is what the RuleQA 
>> process produces.
>
> 50_scores.cf should be generated by mass-checking, where H2 generated
> no score (why?)

Bill was correct. 72_scores.cf is generated by the masscheck/ruleqa 
process. The masscheck/ruleqa process does not evaluate or generate scores 
for all rules, though.

50_scores.cf is fixed scores set either manually or (historically) from a 
different analysis process that is run *very* infrequently. It is not 
generated from the masscheck/ruleqa process.

There is no score for RCVD_IN_MSPIKE_H2 in 50_scores.cf. There are scores 
for the other MSPIKE rules there and the ones appearing there do NOT 
appear in 72_scores.cf so it looks like they are not being evaluated for 
scoring. The score for _H2 was apparently accidentally removed by this 
commit:

https://svn.apache.org/viewvc/spamassassin/trunk/rules/50_scores.cf?r1=1213550&r2=1213551&diff_format=h

I've added a score for RCVD_IN_MSPIKE_H2 back into 50_scores.cf to see 
whether that affects things. It looks like that is the only MSPIKE rule 
that masscheck is generating scores for and I can't really see why apart 
from it not appearing in 50_scores.cf, and at the moment I don't want to 
go spelunking in the code to verify that's the override...



-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org                         pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Politicians never accuse you of "greed" for wanting other people's
   money, only for wanting to keep your own money.    -- Joseph Sobran
-----------------------------------------------------------------------
  4 days until John Moses Browning's 170th Birthday

Re: mailspike dot net Minus 1?

Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
>On 2025-01-15 at 04:21:41 UTC-0500 (Wed, 15 Jan 2025 10:21:41 +0100)
>Matus UHLAR - fantomas <uh...@fantomas.sk>
>is rumored to have said:

>>It seems that RCVD_IN_MSPIKE_H2 is the only one that produces 
>>significant score:
>>
>>50_scores.cf:  score RCVD_IN_MSPIKE_ZBI     2.7
>>50_scores.cf:  score RCVD_IN_MSPIKE_L5      2.5
>>50_scores.cf:  score RCVD_IN_MSPIKE_L4      1.7
>>50_scores.cf:  score RCVD_IN_MSPIKE_L3      0.9
>>50_scores.cf:  score RCVD_IN_MSPIKE_H3      -0.01
>>50_scores.cf:  score RCVD_IN_MSPIKE_H4      -0.01
>>50_scores.cf:  score RCVD_IN_MSPIKE_H5      -1.0
>>50_scores.cf:  score RCVD_IN_MSPIKE_BL      0.01
>>50_scores.cf:  score RCVD_IN_MSPIKE_WL      -0.01

>>72_scores.cf:score RCVD_IN_MSPIKE_BL        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H2        0.001 -1.794 0.001 -1.794
>>72_scores.cf:score RCVD_IN_MSPIKE_H3        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H4        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_H5        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L2        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L3        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L4        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_L5        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_WL        0.001 0.001 0.001 0.001
>>72_scores.cf:score RCVD_IN_MSPIKE_ZBI       0.001 0.001 0.001 0.001

On 15.01.25 09:23, Bill Cole wrote:
>It is worth noting that the 72_scores.cf file is what the RuleQA 
>process produces. I haven't dug into the details, but it looks like 
>Mailspike is ONLY really useful at the H2 level.

that's possible, but according to https://mailspike.io/ip_verify/usage
H2 is supposed to be indication of "Possible legit sender"

50_scores.cf should be generated by mass-checking, where H2 generated no 
score (why?)

and yet, H2 has more significant score that what mass-check generated
L5 (excellent reputation) which should be stronger indicator of hamminess.


>>Does it make sense to use this WL with this score?
>
>That has to be a local question.

This is what I'm curious about. Of course I can locally increase the score 
locally. 

>For the people going to the trouble of submitting human-classified ham 
>and spam results to RuleQA, RCVD_IN_MSPIKE_H2 was a fairly strong 
>indicator of non-spam. So it makes sense IF your mailstream looks a 
>lot like that of the submitters. Sadly, mailstreams vary a  great 
>deal, so no individual site is likely to match the non-random sample 
>that we have access to.

should I assume that RuleQA works with different corpus than masscheck?

>I don't think the listing of behemoth sources as "good-ish" is wrong 
>per se, because many sites can show that they get more ham from GMail 
>than spam. MS is a somewhat different story, because they try to 
>segregate their suspect mail to a subset of output points. If your 
>mail does not include much GMail ham, it may make sense to set the 
>scores locally. E.g. I have:
>
>/etc/mail/spamassassin/local.cf:score      RCVD_IN_MSPIKE_H2 0.2
>/etc/mail/spamassassin/local.cf:score      RCVD_IN_MSPIKE_H3 0.1
>
>Those are based on careful analysis a few years ago, so I can't even 
>be sure that they make sense for me today, but they certainly are not 
>causing visible trouble,

-- 
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Christian Science Programming: "Let God Debug It!".

Re: mailspike dot net Minus 1?

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2025-01-15 at 04:21:41 UTC-0500 (Wed, 15 Jan 2025 10:21:41 +0100)
Matus UHLAR - fantomas <uh...@fantomas.sk>
is rumored to have said:

> Hello,
>
> On 21.09.24 12:51, joe a wrote:
>> Noticed some obvious spam slipping in due in great part to this:
>>
>> 	* -1.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>> 	*      [209.85.166.199 listed in wl.mailspike.net]
>>
>> Not a big deal for my low volume SOHO, but it's annoying.
>>
>> Has that check become unreliable?  Sure, I can skip that check (I 
>> think) or alter the score, but any other thoughts?
>
> FYI:
> 199.166.85.209.in-addr.arpa domain name pointer 
> mail-il1-f199.google.com.

Which demonstrates the problem. Their H2 list includes highly mixed 
sources.

>
> I too have recently received multiple e-mails where sending server was 
> in MSPIKE_H2, pushing them under required_score limit.
>
> many of them were in google and microsoft networks:
>
>         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>         *      [40.92.58.106 listed in wl.mailspike.net]
>
>         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>         *      [209.85.222.65 listed in wl.mailspike.net]
>
>         * -1.8 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2)
>         *      [209.85.218.47 listed in wl.mailspike.net]
>
>
> It seems that RCVD_IN_MSPIKE_H2 is the only one that produces 
> significant score:
>
> 50_scores.cf:  score RCVD_IN_MSPIKE_ZBI     2.7
> 50_scores.cf:  score RCVD_IN_MSPIKE_L5      2.5
> 50_scores.cf:  score RCVD_IN_MSPIKE_L4      1.7
> 50_scores.cf:  score RCVD_IN_MSPIKE_L3      0.9
> 50_scores.cf:  score RCVD_IN_MSPIKE_H3      -0.01
> 50_scores.cf:  score RCVD_IN_MSPIKE_H4      -0.01
> 50_scores.cf:  score RCVD_IN_MSPIKE_H5      -1.0
> 50_scores.cf:  score RCVD_IN_MSPIKE_BL      0.01
> 50_scores.cf:  score RCVD_IN_MSPIKE_WL      -0.01
> 72_scores.cf:score RCVD_IN_MSPIKE_BL                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H2                     0.001 -1.794 
> 0.001 -1.794
> 72_scores.cf:score RCVD_IN_MSPIKE_H3                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H4                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_H5                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L2                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L3                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L4                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_L5                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_WL                     0.001 0.001 
> 0.001 0.001
> 72_scores.cf:score RCVD_IN_MSPIKE_ZBI                    0.001 0.001 
> 0.001 0.001

It is worth noting that the 72_scores.cf file is what the RuleQA process 
produces. I haven't dug into the details, but it looks like Mailspike is 
ONLY really useful at the H2 level.

> Does it make sense to use this WL with this score?

That has to be a local question.

For the people going to the trouble of submitting human-classified ham 
and spam results to RuleQA, RCVD_IN_MSPIKE_H2 was a fairly strong 
indicator of non-spam. So it makes sense IF your mailstream looks a lot 
like that of the submitters. Sadly, mailstreams vary a  great deal, so 
no individual site is likely to match the non-random sample that we have 
access to.

I don't think the listing of behemoth sources as "good-ish" is wrong per 
se, because many sites can show that they get more ham from GMail than 
spam. MS is a somewhat different story, because they try to segregate 
their suspect mail to a subset of output points. If your mail does not 
include much GMail ham, it may make sense to set the scores locally. 
E.g. I have:

/etc/mail/spamassassin/local.cf:score      RCVD_IN_MSPIKE_H2 0.2
/etc/mail/spamassassin/local.cf:score      RCVD_IN_MSPIKE_H3 0.1

Those are based on careful analysis a few years ago, so I can't even be 
sure that they make sense for me today, but they certainly are not 
causing visible trouble,


-- 
  Bill Cole
  bill@scconsult.com or billcole@apache.org
  (AKA @grumpybozo@toad.social and many *@billmail.scconsult.com 
addresses)
  Not Currently Available For Hire