You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2007/08/27 13:49:40 UTC

[Bug 5632] New: remove completewhois DNSBL lookup

http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632

           Summary: remove completewhois DNSBL lookup
           Product: Spamassassin
           Version: SVN Trunk (Latest Devel Version)
          Platform: Other
        OS/Version: other
            Status: NEW
          Severity: minor
          Priority: P5
         Component: Rules
        AssignedTo: dev@spamassassin.apache.org
        ReportedBy: jm@jmason.org


(in a thread about DNS timeouts and long scan times)

Mark Martinec writes:
> On Sunday August 26 2007 22:05:58 Jeff Chan wrote:
> > FWIW completewhois.com and it's host network elan.net appears to be
> > unreachable. completewhois has the HIB blacklist, and probably others.
>
> Right, all queries to combined-HIB.dnsiplists.completewhois.com
> are still timing out, which, depending on rbl_timeout setting,
> can have a significant impact on the average elapsed time of
> a scan. Most of the Saturday it was worse still, likely some
> other RBL server being down too.

If completewhois is still down, and has been having trouble since
people started making comments about it on the users list, we
should probably remove it.  It's only catching 0.3482% of spams,
with a FP rate of 0.0590%:

STATISTICS-set3.txt:  0.244   0.3482   0.0590    0.855   0.57    0.40 
RCVD_IN_WHOIS_INVALID



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-08-27 04:56 -------
Created an attachment (id=4110)
 --> (http://issues.apache.org/SpamAssassin/attachment.cgi?id=4110&action=view)
fix

here's the patch that removes them...



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From spamassassin@dostech.ca  2007-09-20 14:41 -------
Not yet.  I was planning on cutting an update tonight.  I'll add this to it.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-08-27 04:51 -------
oops. there are other lists I missed.  here's their freqs:

rules/STATISTICS-set3.txt:  0.000   0.0007   0.0000    1.000   0.51    0.00 
RCVD_IN_WHOIS_BOGONS
rules/STATISTICS-set3.txt:  0.000   0.0000   0.0000    0.500   0.51    1.00 
RCVD_IN_WHOIS_HIJACKED




------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-08-27 04:50 -------
btw even their website seems down:

http://www.completewhois.com/rbl_lookup.htm

I think they're history.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From mkettler_sa@verizon.net  2007-09-20 16:01 -------
+1 completewhois is still being a problem



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-09-21 00:59 -------
(In reply to comment #12)
> Oh yeah, I'm in no rush for a 3.2.4 release for this either.  Heck, we took a
> month to make another release to fix the bug that prevented most people from
> installing SA via CPAN.

er, I don't think that was something to emulate :(

good point about rules being CTR, and that this can be sorted in an update. 
forgot about that.






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From felicity@apache.org  2007-09-20 14:38 -------
Have we released an update removing these rules?  I don't think it's critical to
get a release out to remove the rules from the distro.

I'm +1 on the patch btw.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From schulz@adi.com  2007-08-30 12:42 -------
The web site is now sort of back up.  It responds with the following message:

Site is temporarily offline while server is rebuilt expect to be back around
September 1st, 2007

But given the hit rate, you might want to remove it anyway.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From odi@odi.ch  2007-09-24 01:36 -------
Their website and blackist is gone. No idea why. But all lookups return a domain
parking IP. This is still minor P5!?!



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From spamassassin@dostech.ca  2007-09-20 20:24 -------
Oh yeah, I'm in no rush for a 3.2.4 release for this either.  Heck, we took a
month to make another release to fix the bug that prevented most people from
installing SA via CPAN.  In comparison, I don't think this is too big a deal.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From schulz@adi.com  2007-09-07 08:30 -------
The web site is back up.  I don't know if the rules would work as I still
have them patched out.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED




------- Additional Comments From jm@jmason.org  2007-09-24 07:44 -------
(In reply to comment #16)
> next step: the update needs to be built on the zone, I haven't done that yet.

now done, using the command in
http://wiki.apache.org/spamassassin/ManualRuleUpdates .



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-09-20 14:27 -------
IMO we should get this applied RSN, and release a 3.2.4 without those rules. 
Right now there appears to be a major slowdown in 3.2's scan speed due to this
issue.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|remove completewhois DNSBL  |[review] remove
                   |lookup                      |completewhois DNSBL lookup
  Status Whiteboard|                            |needs 2 votes for 3.2
   Target Milestone|Undefined                   |3.2.4




------- Additional Comments From jm@jmason.org  2007-09-13 06:54 -------
nobody seems to be objecting to their removal, so let's do that for 3.2.4.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632





------- Additional Comments From jm@jmason.org  2007-09-24 02:23 -------
'This is still minor P5!?!'

don't pay any attention to that, we don't use it.




------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Status Whiteboard|go                          |update needs to be published




------- Additional Comments From jm@jmason.org  2007-09-24 05:33 -------
oops. this patch ommitted URIBL_COMPLETEWHOIS, so I removed that too...

applied to b3_2_0:

: jm 64...; svn commit -m "bug 5632: remove all completewhois.com DNSBL lookups,
site seems to have disappeared without warning"
Sending        rules/20_dnsbl_tests.cf
Sending        rules/50_scores.cf
Sending        rules/active.list
Transmitting file data ...
Committed revision 578785.

applied to 3.2.x updates:

: jm 67...; svn commit -m "bug 5632: remove all completewhois.com DNSBL lookups,
site seems to have disappeared without warning"
Sending        50_scores.cf
Sending        72_active.cf
Transmitting file data ..
Committed revision 578788.


trunk:

: jm 73...; svn commit -m "bug 5632: remove all completewhois.com DNSBL lookups,
site seems to have disappeared without warning" rules
Sending        rules/50_scores.cf
Sending        rules/active.list
Transmitting file data ..
Committed revision 578789.


they all lint ok.
next step: the update needs to be built on the zone, I haven't done that yet.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5632] [review] remove completewhois DNSBL lookup

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5632


spamassassin@dostech.ca changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Status Whiteboard|needs 2 votes for 3.2       |go




------- Additional Comments From spamassassin@dostech.ca  2007-09-20 20:13 -------
+1 also on the patch.  BTW... didn't we change rules/ to CTR?

Applied to the 3.1 and 3.2 update branch copy of the rules in r577966 and
r577965 and included in 3.1 and 3.2 updates 577968 and 577969.





------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.