You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by David Bennett <db...@bensoft.com> on 2011/09/24 10:04:39 UTC
Increasing score based on membership to commercial whitelist
I read an interesting excerpt on the Zimbra site about commercial
whitelists.
http://wiki.zimbra.com/wiki/Improving_Anti-spam_system#Externally-Maintained_Whitelists
It occurred to me that a sender that is paying their way into my inbox
is almost certainly sending me junk mail. A little research in my
inbox and it turns out to be right on the money. All stuff that I
didn't want.
It seems so obvious, if they try to buy their way into my inbox they
probably belong in my spam folder.
I took the reduced negative scores recommended by Zimbra, inverted the
values and stored these in my local.cf.
# commercial buy-in whitelists (most likely junk)
score RCVD_IN_BSP_TRUSTED 0.500
score RCVD_IN_BSP_OTHER 0.500
score RCVD_IN_BONDEDSENDER 0.500
score HABEAS_ACCREDITED_COI 0 0.5 0 0.5
score HABEAS_ACCREDITED_SOI 0 0.25 0 0.25
score HABEAS_CHECKED 0 0.1 0 0.1
score RCVD_IN_IADB_VOUCHED 0 0.2 0 0.2
score RCVD_IN_IADB_DOPTIN 0 0.4 0 0.4
score RCVD_IN_IADB_ML_DOPTIN 0 0.6 0 0.6
score RCVD_IN_DNSWL_LOW 0 0.1 0 0.1
score RCVD_IN_DNSWL_MED 0 0.4 0 0.4
score RCVD_IN_DNSWL_HI 0 0.8 0 0.8
--Dave
Re: Increasing score based on membership to commercial whitelist
Posted by Simon Loewenthal <si...@klunky.co.uk>.
"David F. Skoll" <df...@roaringpenguin.com> wrote:
On Mon, 26 Sep 2011 13:49:36 -0400
darxus@chaosreigns.com wrote:
> On 09/24, David Bennett wrote:
> > It occurred to me that a sender that is paying their way into my
> > inbox is almost certainly sending me junk mail. A little research
> > in my inbox and it turns out to be right on the money. All stuff
> > that I didn't want.
> Disclaimer: I'm a dnswl.org admin, although haven't been active
> lately. Also, dnswl.org (provider of the data used by RCVD_IN_DNSWL_*
> rules) doesn't charge anybody for being listed. They only charge
> very high volume users of the data for use of the data, like Spamhaus
> and some other major blacklist providers.
As someone listed on dnswl.org, I can confirm this. We did not pay to
get our domain (roaringpenguin.com) or IP addresses listed. And I
assume that if we spam, we will be delisted in a hurry.
So please don't automatically assume that we're spammers just because
we're on dnswl.org. :)
Regards,
David.
My domains are listed on dnswl.org, & I did not pay a penny, although if I had then it would have been a penny worth paying for :)
--
If you cannot beat them, try to cĂ´ntrole them.
Re: Increasing score based on membership to commercial whitelist
Posted by Ned Slider <ne...@unixmail.co.uk>.
On 26/09/11 19:00, David F. Skoll wrote:
> On Mon, 26 Sep 2011 13:49:36 -0400
> darxus@chaosreigns.com wrote:
>
>> On 09/24, David Bennett wrote:
>>> It occurred to me that a sender that is paying their way into my
>>> inbox is almost certainly sending me junk mail. A little research
>>> in my inbox and it turns out to be right on the money. All stuff
>>> that I didn't want.
>
>> Disclaimer: I'm a dnswl.org admin, although haven't been active
>> lately. Also, dnswl.org (provider of the data used by RCVD_IN_DNSWL_*
>> rules) doesn't charge anybody for being listed. They only charge
>> very high volume users of the data for use of the data, like Spamhaus
>> and some other major blacklist providers.
>
> As someone listed on dnswl.org, I can confirm this. We did not pay to
> get our domain (roaringpenguin.com) or IP addresses listed. And I
> assume that if we spam, we will be delisted in a hurry.
>
> So please don't automatically assume that we're spammers just because
> we're on dnswl.org. :)
>
> Regards,
>
> David.
>
Same here.
I'm not generally a big fan of whitelists (at least not someone else's
whitelists), but the fact I bothered to sign up serves as a good
indicator of the level of trust I have in dnswl.org - and that's trust
that has been earned based on what I see within my own mail flow.
Each to their own of course, but I have no issue with dnswl.org nor it's
default scoring in SA which seems very reasonable to me.
Re: Increasing score based on membership to commercial whitelist
Posted by "David F. Skoll" <df...@roaringpenguin.com>.
On Mon, 26 Sep 2011 13:49:36 -0400
darxus@chaosreigns.com wrote:
> On 09/24, David Bennett wrote:
> > It occurred to me that a sender that is paying their way into my
> > inbox is almost certainly sending me junk mail. A little research
> > in my inbox and it turns out to be right on the money. All stuff
> > that I didn't want.
> Disclaimer: I'm a dnswl.org admin, although haven't been active
> lately. Also, dnswl.org (provider of the data used by RCVD_IN_DNSWL_*
> rules) doesn't charge anybody for being listed. They only charge
> very high volume users of the data for use of the data, like Spamhaus
> and some other major blacklist providers.
As someone listed on dnswl.org, I can confirm this. We did not pay to
get our domain (roaringpenguin.com) or IP addresses listed. And I
assume that if we spam, we will be delisted in a hurry.
So please don't automatically assume that we're spammers just because
we're on dnswl.org. :)
Regards,
David.
Re: Increasing score based on membership to commercial whitelist
Posted by da...@chaosreigns.com.
On 09/24, David Bennett wrote:
> It occurred to me that a sender that is paying their way into my inbox
> is almost certainly sending me junk mail. A little research in my
> inbox and it turns out to be right on the money. All stuff that I
> didn't want.
Disclaimer: I'm a dnswl.org admin, although haven't been active lately.
Also, dnswl.org (provider of the data used by RCVD_IN_DNSWL_* rules)
doesn't charge anybody for being listed. They only charge very high
volume users of the data for use of the data, like Spamhaus and some
other major blacklist providers.
Most of what I want to say is that spamassassin generally assigns scores
very carefully calculated to give the most accurate results. The mass-check
process takes lots of real-world spams and non-spams, and using that
calculates ideal scores for every rule.
Although the DNSWL rules are among those which have hard-coded (not
"mutable") scores. I believe this is because it's a problem to get the
mass-check contributors to set their trusted_networks reliably enough
to avoid really messing up the results.
It might help if the submitted mass-check data included a one way salted
hash of the last untrusted IP, with a different salt per user, so we could
verify they're not showing a bunch of spam all from the same IP address,
which is likely to mean they have a trusted_networks configured poorly
(it would mean that reported address is probably a trusted relay).
As you can imagine, the mass-check process can always use more contributors
to increase the accuracy of spamassassin. You are only uploading a list of
the tests each email hit, not the emails themselves, so it's not a privacy
concern. To contribute:
http://wiki.apache.org/spamassassin/NightlyMassCheck
The dev@ mailing list occasionally requires some harassing to get new
accounts created, which also drives me nuts.
Also, as you can imagine, having your trusted_networks not configured
properly will also screw up the results of many of the network tests.
--
"Every normal man must be tempted at times to spit upon his hands,
hoist the black flag, and begin slitting throats."
- Henry Louis Mencken (1880-1956)
http://www.ChaosReigns.com
Re: Increasing score based on membership to commercial whitelist
Posted by Benny Pedersen <me...@junc.org>.
On Sat, 24 Sep 2011 03:04:39 -0500, David Bennett wrote:
> # commercial buy-in whitelists (most likely junk)
read it one more time, do you think buy-in liste will get ones own ip
whitelisted ?, and where can i buy such lists ?, dns is free and one can
make it for free if other rules sooks
if you dont agree with dnswl why not blacklist them in mta and save
time ?
Re: Increasing score based on membership to commercial whitelist
Posted by Bowie Bailey <Bo...@BUC.com>.
On 10/11/2011 5:49 PM, Kris Deugau wrote:
>
> I contacted LinkedIn support a couple of times about including a "don't
> email me" link on their various send-to-a-friend-ish emails; while I'm
> still getting these things reported by customers as spam, they do,
> finally, have a link on the invitation mails that supposedly adds you to
> a "Do not email" list.
>
> I can't comment on the effectiveness.
I have used that link on a few occasions now. So far, it seems to be
effective. No more LinkedIn junk on those addresses.
--
Bowie
Re: Increasing score based on membership to commercial whitelist
Posted by Kris Deugau <kd...@vianet.ca>.
Michael Scheidell wrote:
> I have sent linkedin spam to returnpath, to their APPROVED reporting
> email address, which is certification@returnpath.net for almost two years.
> This spam had no remove links, no unsubscription information, and the
> only way to stop spam from the specific spammer who used linked in, was
> to sign up for linked in, agree to their terms (which allowed people to
> spam you). and, return path argued with me for months and months,
> telling me that it wasn't spam, that I signed up for it (but could not
> prove it) and that it was 'transactional email' (since I had signed up
> for it.. which I hadn't)
I contacted LinkedIn support a couple of times about including a "don't
email me" link on their various send-to-a-friend-ish emails; while I'm
still getting these things reported by customers as spam, they do,
finally, have a link on the invitation mails that supposedly adds you to
a "Do not email" list.
I can't comment on the effectiveness.
-kgd
Re: Increasing score based on membership to commercial whitelist
Posted by Michael Scheidell <mi...@secnap.com>.
On 10/11/11 8:55 AM, Greg Troxel wrote:
> To returnpath's credit, it appears that the
> addresses linkedin uses to send invitation spam to mailinglists have
> been delisted - but this should have happened within a few business days
> of the first complaint.
>
I have sent linkedin spam to returnpath, to their APPROVED reporting
email address, which is certification@returnpath.net for almost two years.
This spam had no remove links, no unsubscription information, and the
only way to stop spam from the specific spammer who used linked in, was
to sign up for linked in, agree to their terms (which allowed people to
spam you). and, return path argued with me for months and months,
telling me that it wasn't spam, that I signed up for it (but could not
prove it) and that it was 'transactional email' (since I had signed up
for it.. which I hadn't)
and, for linked in, all they needed, to keep me from complaining, was a
link like twitter had: 'report this as abuse', AND, 'I never want to
hear from linked in about anything, ever again', and for US CAN-SPAM
compliance, the full, physical address of the spammer.
--
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
>*| *SECNAP Network Security Corporation
* Best Mobile Solutions Product of 2011
* Best Intrusion Prevention Product
* Hot Company Finalist 2011
* Best Email Security Product
* Certified SNORT Integrator
______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r).
For Information please see http://www.spammertrap.com/
______________________________________________________________________
Re: Increasing score based on membership to commercial whitelist
Posted by Greg Troxel <gd...@ir.bbn.com>.
Most of my experience receiving "certified spam" has been with
returnpath. It's still too hard to find how to report abuse (it's not a
prominent link on the returnpath.net), and reporting spam that they've
certified has been only somewhat satisfactory - a few places have been
delisted, but not promptly. To returnpath's credit, it appears that the
addresses linkedin uses to send invitation spam to mailinglists have
been delisted - but this should have happened within a few business days
of the first complaint.
The HOSTKARMA_WL list, on the other hand, seems to be mostly accurate,
but more importantly, when I get spam from a host in it, I forward it to
support@junkemailfilter.com with a delisting request, and almost always
the result is the IP address delisted in well under a day (often an
hour).
With returnpath (BSP/HABEAS), I suspect that there are multiple kinds of
entities listed. Some are legitimate transaction mail (e.g. banks
sending to addresses they think belong to their customers, and trying to
avoid being misfiled), and some are not legitimate.
SA takes a statistical approach. For tests and lists where that's a
fair description of the world, that's sensible. pay-to-list
whitelists break the assumptions, because there are incentives other
than avoiding spam at play. Given how slowly pay-to-list whitelists
delist spammers, it's clear those effects are substantial.
Another complicating factor is spammy mail that is legitimately opt in,
and listed in a whitelists. If I choose not to get any of that, then
the subset of my mail that's in a pay-to-list whitelist is small and
mostly spam. If I did sign up for that sort of mail, it would have more
ham. So the notion of a single spam score for all audiences for a
whitelist rule is problematic.
My conclusions:
whitelists that don't take money from people to be on them tend to be
ok.
It's good to complain to every whitelist about every whitelisted spam
received, except maybe dnswl_low when it's reasonably obviously a
compromised machine.
For people who don't sign up for spammy-seeming opt-in lists,
returnpath's whitelist is probably best given a mild positive score
(2ish?). I choose to leave it at the default score and complain about
certified spam instead.
I am unclear on IADB quality.
Re: Increasing score based on membership to commercial whitelist
Posted by da...@chaosreigns.com.
On 09/24, David Bennett wrote:
> It occurred to me that a sender that is paying their way into my inbox
> is almost certainly sending me junk mail. A little research in my
> inbox and it turns out to be right on the money. All stuff that I
> didn't want.
I'm very curious what exactly your statistics looked like. I'll point you
to the spamassassin Rule QA stats that are publicly available:
> # commercial buy-in whitelists (most likely junk)
> score RCVD_IN_BSP_TRUSTED 0.500
> score RCVD_IN_BSP_OTHER 0.500
> score RCVD_IN_BONDEDSENDER 0.500
> score HABEAS_ACCREDITED_COI 0 0.5 0 0.5
> score HABEAS_ACCREDITED_SOI 0 0.25 0 0.25
> score HABEAS_CHECKED 0 0.1 0 0.1
I don't see any of the above in the current spamassassin rules. What
version of spamassassin are you running? Anything before 3.3.0 is very
much not recommended.
Ah yes, all but RCVD_IN_BONDEDSENDER were replaced with
RCVD_IN_RP_CERTIFIED in version 3.3.0:
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6247
And it looks like RCVD_IN_BONDEDSENDER was replaced by RCVD_IN_BSP_OTHER
and RCVD_IN_BSP_TRUSTED some time over four years ago:
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=5476
I'm guessing you're not actually getting hits on any of these six, and just
added them based on an article that hasn't been updated in four years?
> score RCVD_IN_IADB_VOUCHED 0 0.2 0 0.2
> score RCVD_IN_IADB_DOPTIN 0 0.4 0 0.4
> score RCVD_IN_IADB_ML_DOPTIN 0 0.6 0 0.6
http://ruleqa.spamassassin.org/?daterev=20110924-r1175130-n&rule=%2FRCVD_IN_IADB
MSECS SPAM% HAM% S/O RANK SCORE NAME WHO/AGE
0 0 0.0117 0.000 0.46 0.00 RCVD_IN_IADB_VOUCHED
0 0 0.7806 0.000 0.66 0.00 RCVD_IN_IADB_DOPTIN
0 0 0 0.500 0.45 0.00 RCVD_IN_IADB_ML_DOPTIN
Hit ZERO out of 362,124 spams. Also hit a pretty insignificant amount
of ham (non-spam).
> score RCVD_IN_DNSWL_LOW 0 0.1 0 0.1
> score RCVD_IN_DNSWL_MED 0 0.4 0 0.4
> score RCVD_IN_DNSWL_HI 0 0.8 0 0.8
http://ruleqa.spamassassin.org/?daterev=20110924-r1175130-n&rule=%2FDNSWL
MSECS SPAM% HAM% S/O RANK SCORE NAME WHO/AGE
0 0.0003 1.8893 0.000 0.75 0.00 RCVD_IN_DNSWL_HI
0 0.0224 25.6371 0.001 0.86 0.00 RCVD_IN_DNSWL_MED
0 0.0376 12.0356 0.003 0.79 0.00 RCVD_IN_DNSWL_LOW
0 0.2090 21.8867 0.009 0.66 0.00 RCVD_IN_DNSWL_NONE
25.6% of ham hits RCVD_IN_DNSWL_MED. So you're adding a score of 0.4
to a quarter of your ham, when that rule is only hitting 0.02% of spam
(81 out of 362,124 spams). And that's just one of the three dnswl rules
you're scoring as bad.
I have pretty graphs of dnswl stats over time here:
http://www.chaosreigns.com/dnswl/
(Chrome renders that badly, firefox renders it well, the
non-standardization pains me.)
The two at the bottom are spam vs. ham numbers in the mass-check corpora,
not specific to dnswl.
I assure you, if there were a test that was causing spam to get through,
that wasn't still worth running because a vastly overwhelming majority
of the emails it hit were ham (theoretically reducing false positives,
which is more important than missing a few spams), spamassassin developers
would be very interested to hear about it, and remove it.
If you have that kind of information, please do provide it.
--
"If you are not paranoid... you may not be paying attention."
- jimh@creative-net.net, on an IDPA mailing list
http://www.ChaosReigns.com
Re: Increasing score based on membership to commercial whitelist
Posted by jdow <jd...@earthlink.net>.
Something more interesting would be to give then nominal scores, say
0.01. Then you can use hit statistics to determine whether or not you
should use the whitelist and how good or bad it might be. (I suspect
results might be surprising.)
{^_^}
On 2011/09/25 10:46, Roger Marquis wrote:
> RW wrote:
>>> I took the reduced negative scores recommended by Zimbra, inverted the
>>> values and stored these in my local.cf.
>>
>> That means you're penalising the better ones more than the worse ones.
>
> Exactly. For those of us who don't track the accuracy of these DNSWLs
> the best policy IMO is to simply disable them:
>
> meta RCVD_IN_DNSWL_HI 0
> meta RCVD_IN_DNSWL_MED 0
> meta RCVD_IN_DNSWL_LOW 0
> meta RCVD_IN_IADB_VOUCHED 0
> meta RCVD_IN_IADB_DOPTIN 0
> meta RCVD_IN_IADB_ML_DOPTIN 0
> meta RCVD_IN_BSP_OTHER 0
> meta RCVD_IN_BSP_TRUSTED 0
> meta RCVD_IN_BONDEDSENDER 0
> meta HABEAS_ACCREDITED_COI 0
> meta HABEAS_ACCREDITED_SOI 0
> meta HABEAS_CHECKED 0
>
> Roger Marquis
>
Re: Increasing score based on membership to commercial whitelist
Posted by Roger Marquis <ma...@roble.com>.
RW wrote:
>> I took the reduced negative scores recommended by Zimbra, inverted the
>> values and stored these in my local.cf.
>
> That means you're penalising the better ones more than the worse ones.
Exactly. For those of us who don't track the accuracy of these DNSWLs
the best policy IMO is to simply disable them:
meta RCVD_IN_DNSWL_HI 0
meta RCVD_IN_DNSWL_MED 0
meta RCVD_IN_DNSWL_LOW 0
meta RCVD_IN_IADB_VOUCHED 0
meta RCVD_IN_IADB_DOPTIN 0
meta RCVD_IN_IADB_ML_DOPTIN 0
meta RCVD_IN_BSP_OTHER 0
meta RCVD_IN_BSP_TRUSTED 0
meta RCVD_IN_BONDEDSENDER 0
meta HABEAS_ACCREDITED_COI 0
meta HABEAS_ACCREDITED_SOI 0
meta HABEAS_CHECKED 0
Roger Marquis
Re: Increasing score based on membership to commercial whitelist
Posted by RW <rw...@googlemail.com>.
On Sat, 24 Sep 2011 03:04:39 -0500
David Bennett wrote:
> I read an interesting excerpt on the Zimbra site about commercial
> whitelists.
>
>
> http://wiki.zimbra.com/wiki/Improving_Anti-spam_system#Externally-Maintained_Whitelists
>
> It occurred to me that a sender that is paying their way into my inbox
> is almost certainly sending me junk mail. A little research in my
> inbox and it turns out to be right on the money. All stuff that I
> didn't want.
>
> It seems so obvious, if they try to buy their way into my inbox they
> probably belong in my spam folder.
The point of these lists is that companies should suffer financially
and/or get kicked off the lists if they abuse them. It's not obvious
that they should be treated as spam indicators. It depends on how well
they are run and whether you have a lot legitimate opt-in marketing
mail.
> I took the reduced negative scores recommended by Zimbra, inverted the
> values and stored these in my local.cf.
That means you're penalising the better ones more than the worse ones.
> score RCVD_IN_DNSWL_LOW 0 0.1 0 0.1
> score RCVD_IN_DNSWL_MED 0 0.4 0 0.4
> score RCVD_IN_DNSWL_HI 0 0.8 0 0.8
DNSWL is a genuine reputation-based list - it doesn't deserve positive
scores.