You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2009/12/15 22:58:15 UTC

[Bug 6259] New: Evaluate ReturnPath's RNBL

https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

           Summary: Evaluate ReturnPath's RNBL
           Product: Spamassassin
           Version: 3.3.0
          Platform: Other
        OS/Version: All
            Status: NEW
          Severity: enhancement
          Priority: P5
         Component: Rules
        AssignedTo: dev@spamassassin.apache.org
        ReportedBy: wtogami@redhat.com


This bug is splitting off the DNSBL from Bug #6247.

# Return Path Reputation Network Blacklist (RNBL):
# https://senderscore.org/blacklistlookup/
header RCVD_IN_RP_RNBL        
eval:check_rbl('rnbl-lastexternal','bl.score.senderscore.com.')
describe RCVD_IN_RP_RNBL       Relay in RNBL,
https://senderscore.org/blacklistlookup/

We have no formal written requirements for accepting a new blacklist in
spamassassin yet.  But if we did have requirements they might contain things
like:

1) Sufficient capacity to handle global lookups and DoS attacks on your
infrastructure.
2) What volume do you allow for free?
3) Clearly written listing and delisting policy.
4) Clearly superior performance demonstrated in weekly masschecks.

#1 I'm guessing ReturnPath has no problem.
#3 Might already be clear enough, not sure.
#2 Requires further discussion about acceptability to the spamassassin project.

#4 http://ruleqa.spamassassin.org/20091212-r889898-n/T_RCVD_IN_RP_RNBL/detail 
We have had only one weekend of data on the performance of RNBL.  Very few FP's
but small spam detection rate as well.  This might be considered too small to
be worthwhile to be added as a spamassassin default rule, especially given your
stated intention to have volume limits and payment requirements in the future.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

--- Comment #6 from J.D. Falk <jd...@returnpath.net> 2009-12-16 11:10:43 UTC ---
(In reply to comment #5)
> One last confirmation from Return Path:
> 
> RNBL stays for the long-term?
> 
> Once we add this, it wont be trivial to get everyone to stop using it.

We've had a blacklist in this same DNS zone for 3+ years, and it's used by some
big ISPs.  No plans to get rid of it.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

--- Comment #4 from J.D. Falk <jd...@returnpath.net> 2009-12-16 07:42:14 UTC ---
(In reply to comment #2)

> SSBL and RNBL are now served by the same company?

Sorry, I assumed the beta SSBL rule would've faded away by now.

It's always been the same company; it's even the same DNS zone.  We've got new
analytics technology (and more data) in the background, and our marketing team
gave the list a new name.  Might as well consider it identical.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

Warren Togami <wt...@redhat.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|Evaluate ReturnPath's RNBL  |Evaluate ReturnPath's RNBL,
                   |                            |replace SSBL?

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

Warren Togami <wt...@redhat.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Priority|P5                          |P1
   Target Milestone|Undefined                   |3.3.0
           Severity|enhancement                 |normal

--- Comment #3 from Warren Togami <wt...@redhat.com> 2009-12-15 21:20:43 UTC ---
This might have a simple resolution if it is simply a matter of replacing SSBL
with RNBL, thus setting for P1.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

Justin Mason <jm...@jmason.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |jm@jmason.org

--- Comment #1 from Justin Mason <jm...@jmason.org> 2009-12-15 14:53:59 UTC ---
should we ignore RCVD_IN_SSBL?  it seems to be essentially the same thing,
right?  (bug 6080)

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

--- Comment #7 from Warren Togami <wt...@redhat.com> 2009-12-16 11:16:14 UTC ---
Weekly Masscheck 20091216
=======================
# SUMMARY for threshold 5.0:
# Correctly non-spam: 246432  99.33%
# Correctly spam:     174605  93.82%
# False positives:      1670  0.67%
# False negatives:     11501  6.18%
# TCR(l=50): 1.958990  SpamRecall: 93.820%  SpamPrec: 99.053%

Weekly Masscheck 20091216, SSBL disabled, RNBL given SSBL's scores
============================================================
# Correctly non-spam: 246439  99.33%
# Correctly spam:     174576  93.80%
# False positives:      1663  0.67%
# False negatives:     11530  6.20%
# TCR(l=50): 1.965632  SpamRecall: 93.805%  SpamPrec: 99.056%

This appears to be a negligible difference with a clearly understood change.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

Warren Togami <wt...@redhat.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |alex.uribl@gmail.com,
                   |                            |jdfalk@returnpath.net,
                   |                            |kmcgrail@pccc.com,
                   |                            |neil.schwartzman@returnpath
                   |                            |.net

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

--- Comment #2 from Warren Togami <wt...@redhat.com> 2009-12-15 21:09:22 UTC ---
http://ruleqa.spamassassin.org/20091212-r889898-n/RCVD_IN_SSBL/detail
http://ruleqa.spamassassin.org/20091212-r889898-n/T_RCVD_IN_RP_RNBL/detail

It does appear that SSBL is a superset of RNBL, but nearly identical.  RNBL
seems to exclude a tiny bit of SSBL that was causing the poor FP performance.

SSBL and RNBL are now served by the same company?

Where are SSBL's listing and delisting policy?
What is the intended future for SSBL?

It seems that we may be better off replacing SSBL with RNBL for the 3.3.0
release, but we need more firm commitments about the future of RNBL.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Use ReturnPath's RNBL, replacing SSBL

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

Warren Togami <wt...@redhat.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED
            Summary|Evaluate ReturnPath's RNBL, |Use ReturnPath's RNBL,
                   |replace SSBL?               |replacing SSBL

--- Comment #8 from Warren Togami <wt...@redhat.com> 2009-12-16 11:26:47 UTC ---
r891391 | wtogami | 2009-12-16 14:25:47 -0500 (Wed, 16 Dec 2009) | 4 lines

Bug #6259: Use ReturnPath's RNBL, replacing SSBL
RNBL is almost identical to SSBL, except safer for FP's.
RNBL takes SSBL's former GA assigned score, and SSBL is removed entirely

Sending        rules/50_scores.cf
Sending        rulesrc/10_force_active.cf
Deleting       rulesrc/sandbox/kb/20_bug_6080.cf
Sending        rulesrc/sandbox/wtogami/20_rp_certified.cf
Transmitting file data ...
Committed revision 891391.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

[Bug 6259] Evaluate ReturnPath's RNBL, replace SSBL?

Posted by bu...@bugzilla.spamassassin.org.
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6259

--- Comment #5 from Warren Togami <wt...@redhat.com> 2009-12-16 07:54:58 UTC ---
One last confirmation from Return Path:

RNBL stays for the long-term?

Once we add this, it wont be trivial to get everyone to stop using it.

-- 
Configure bugmail: https://issues.apache.org/SpamAssassin/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.