You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Theo Van Dinter <fe...@kluge.net> on 2004/08/28 03:31:43 UTC
SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
*** THIS IS A RELEASE CANDIDATE ONLY, NOT THE FINAL 3.0.0 RELEASE ***
SpamAssassin 3.0.0-rc2 is released! SpamAssassin 3.0.0 is a major update
and includes a number of new email and anti-spam technologies.
SpamAssassin is a mail filter which uses advanced statistical and
heuristic tests to identify spam (also known as unsolicited bulk email).
Highlights of the release
-------------------------
- SpamAssassin is now part of the Apache Software Foundation and has an
improved software license, the 2.0 version of the Apache License.
- SpamAssassin now includes support for SPF (the Sender Policy Framework,
http://spf.pobox.com/) which is the basis for the forthcoming Sender-ID
specification.
- Web site links contained in the message are checked against SURBL and
SBL. SURBL and SBL track sites that advertise with spam, known spam
sources, and spam services.
- The new 3.0 architecture allows third-parties to easily add plugin modules.
- There is now SQL database support for both the Bayes and auto-whitelist
modules, allowing more large sites to easily deploy SpamAssassin.
- A more accurate simulation of email client handling of MIME and HTML
improves our accuracy. In addition, there is better detection and
handling of spammer techniques that try to trick anti-spam software.
Downloading
-----------
Pick it up from:
http://spamassassin.apache.org/released/Mail-SpamAssassin-3.0.0-rc2.tar.gz
http://spamassassin.apache.org/released/Mail-SpamAssassin-3.0.0-rc2.tar.bz2
http://spamassassin.apache.org/released/Mail-SpamAssassin-3.0.0-rc2.zip
md5sum of archive files:
9a48264cb220d69449308618154c1d18 Mail-SpamAssassin-3.0.0-rc2.tar.bz2.md5
168d60e6d8936a11285f827baac7bc9a Mail-SpamAssassin-3.0.0-rc2.tar.gz.md5
db019808fc45a930f12151eb676e3870 Mail-SpamAssassin-3.0.0-rc2.zip.md5
sha1sum of archive files:
4e3785a6726c890a915a41ce0a677f4b866cb8db Mail-SpamAssassin-3.0.0-rc2.tar.bz2.sha1
f1d98f51eb8c81c7209ed9a78bdee28f82db81cb Mail-SpamAssassin-3.0.0-rc2.tar.gz.sha1
91fffa572bbcdf9bcc6ba5fc8141e03b7cd690f5 Mail-SpamAssassin-3.0.0-rc2.zip.sha1
The release files also have a .asc accompanying them. The file serves
as an external GPG signature for the given release file. The signing
key is available via the wwwkeys.pgp.net key server, as well as
http://spamassassin.apache.org/released/GPG-SIGNING-KEY
The key information is:
pub 1024D/265FA05B 2003-06-09 SpamAssassin Signing Key <re...@spamassassin.org>
Key fingerprint =3D 26C9 00A4 6DD4 0CD5 AD24 F6D7 DEE0 1987 265F A05B
Important installation notes
----------------------------
- The SpamAssassin 2.6x release series was the last set of releases to
officially support perl versions earlier than perl 5.6.1. If you are
using an earlier version of perl, you will need to upgrade before you
can use the 3.0.0 version of SpamAssassin.
- SpamAssassin 3.0.0 has a significantly different API (Application
Program Interface) from the 2.x series of code. This means that if you
use SpamAssassin through a third-party utility (milter, etc,) you need
to make sure you have an updated version which supports 3.0.0.
- The --auto-whitelist and -a options for "spamd" and "spamassassin" to
turn on the auto-whitelist have been removed and replaced by the
"use_auto_whitelist" configuration option which is also now turned on by
default.
- The "rewrite_subject" and "subject_tag" configuration options were
deprecated and are now removed. Instead, using "rewrite_header Subject
[your desired setting]". e.g.
rewrite_subject 1
subject_tag ****SPAM(_SCORE_)****
becomes
rewrite_header Subject ****SPAM(_SCORE_)****
- The Bayesian storage modules have been completely re-written and now
include Berkeley DB (DBM) storage as well as SQL based storage (see
sql/README.bayes for more information). In addition, a new format has
been introduced for the bayes database that stores tokens in fixed
length hashes. All DBM databases should be automatically converted to
this new format the first time they are opened for write. You can
manually perform the upgrade by running "sa-learn --sync" from the
command line.
The "sa-learn --rebuild" command has been deprecated; please use
"sa-learn --sync" instead. The --rebuild option will remain temporarily
for backwards compatibility.
- "spamd" now has a default max-children setting of 5; no more than 5
child scanner processes will be run in parallel. Previously, there was
no default limit unless you specified the "-m" switch when starting
spamd.
- If you are using a UNIX machine with all database files on local disks,
and no sharing of those databases across NFS filesystems, you can use a
more efficient, but non-NFS-safe, locking mechanism. Do this by adding
the line "lock_method flock" to the /etc/mail/spamassassin/local.cf
file. This is strongly recommended if you're not using NFS, as it is
much faster than the NFS-safe locker.
- Please note that the use of the following command line parameters for
spamassassin and spamd have been deprecated and are now removed. If you
currently use these flags, please remove them:
in the 2.6x series: --add-from, --pipe, -F, -P, --stop-at-threshold, -S
in the 3.0.x series: --auto-whitelist, -a
- The following flags are deprecated and will be removed in a future major
release: --whitelist-factory, -M, --warning-from, -w, --log-to-mbox, -l.
- SpamAssassin runs in "taint mode" by default for improved security.
Certain third-party modules, such as Razor v2, may be incompatible with
taint mode. For Razor v2, you will need to be using v2.40 of
razor-agents or higher which allows taint mode by default. Earlier
versions which are patched to allow taint mode may be used as well.
- Finally, 2.6x deprecated the use of the "check_bayes_db" script, and it
is now no longer available. Please see the sa-learn man/pod
documentation for more info.
Summary of major changes since 2.6x
-----------------------------------
Licensing:
- Relicensed using Apache License v2.0, instead of dual GPL/PAL licensing,
since we are now an Apache Incubator project.
New rules:
- SPF testing, if the Mail::SPF::Query module is installed.
- added new rules and code to combat Bayes poisoning text and random
hash-busters; Habeas rules now verify against the Habeas user
list, to combat forged marks used in spam.
- URIDNSBL rules. These do DNSBL lookups on URLs, allowing URLs found
in the message body to be used in spam determination. Added the SURBL
blocklist (http://www.surbl.org/).
- Spamhaus XBL and a variety of new DNSBL rules
- Hashcash support.
- added Bob Menschel's 'longwords' rules
- added 'backhair' rule, technique based on Jennifer Wheeler's ruleset
- added Matt Kettler's 'antidrug' ruleset
- added anti-fraud rules from Matt Yackley
- added some hostname-based blocklist tests based on the envelope
sender address.
- a *lot* of other new rules, too many to detail here
Spamd:
- spamd now uses a 'preforking' model instead of 'fork per message'.
- new log format, detailing message-id, resent-message-id, the tests hit,
autolearn status, and several other things in a mass-check compatible
format, to provide more information for spamd log-summarizer scripts.
Infrastructure:
- Plugins. Third-party modules can now be written and loaded dynamically
from inside SpamAssassin, to provide support for entirely new rule types
or eval tests.
- SQL support for Bayes and AWL storage, thanks to Michael Parker.
See sql/README.bayes and sql/README.awl for additional information.
- ground-up rewrite of the MIME parser. Now deals correctly with complex
MIME structures, including entire message/rfc822 message attachments.
- rules can now test the "MAIL FROM:" address used in the SMTP transaction,
if it was logged to the message headers, using the "EnvelopeFrom"
pseudoheader. This allows rules such as SPF to be applied.
- Added optional faster but NFS-unsafe Bayes locking mechanism, using
"lock_method flock"
- support for parsing mbx mailboxes, as used by UW IMAP. Thanks to John
Newman for this patch.
- refactored configuration parser to split parser code from configuration
settings.
- Bayes databases can now be backed up and restored using --backup and
--restore.
- Config files can now include other files using the "include" command.
- replaced GA-based evolver with fast Perceptron score generation tool by
Henry Stern; scores can now be generated much more quickly.
- The "spamassassin" script can now check collections of mail en masse. This
lets us do things like 'spamassassin -d --mbox file1' and have the
functionality go over the entire mbox file. same for checks, adding to
white/black-lists, etc.
- Windows support improved.
Translations:
- Dutch translation, thanks to Jesse Houwing
- Polish translations from Jerzy Szczudlowski and radek at alter dot pl
- French translations, Michel Bouissou
- German translations, Klaus Heinz
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Kai Schaetzl <ma...@conactive.com>.
Everything ok so far. Suse 9.0 with latest MailScanner.
I still get this when linting, but URIDNSBL seems to work. Is this
sequence to be expected?
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8d27c4c)
inhibited further callbacks
Kai
--
Kai Schätzl, Berlin, Germany
Get your web at Conactive Internet Services: http://www.conactive.com
IE-Center: http://ie5.de & http://msie.winware.org
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Lucas Albers <ad...@cs.montana.edu>.
Duncan Hill said:
> Majordomo 2 has a neat Makefile.PL that checks the versions of all the
> required an optional stuff, and displays the version you have vs the
> desired
> version. It blocks on required stuff, but will continue on optional.
> Might
> want to look at that method as a way to do it?
>
Code it up and submit it as a patch in bugzilla for the next version!
--
Luke Computer Science System Administrator
Security Administrator,College of Engineering
Montana State University-Bozeman,Montana
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Duncan Hill <sa...@nacnud.force9.co.uk>.
On Saturday 28 August 2004 22:33, Theo Van Dinter might have typed:
> On Sat, Aug 28, 2004 at 01:04:27PM -0700, Bart Schaefer wrote:
> > On the other hand, if you know version numbers of packages that are
> > required, why haven't you listed them in the Makefile.PL prequisites?
>
> Well, the reason for that is Net::DNS isn't required for SpamAssassin to
> work, so it's not really a prerequisite like HTML::Parser or Digest::SHA1.
> Arguably, the Makefile should throw a warning if it finds Net::DNS
> available, but an old version, just to let you know that you won't be
> able to use it.
Majordomo 2 has a neat Makefile.PL that checks the versions of all the
required an optional stuff, and displays the version you have vs the desired
version. It blocks on required stuff, but will continue on optional. Might
want to look at that method as a way to do it?
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Theo Van Dinter <fe...@kluge.net>.
On Sat, Aug 28, 2004 at 01:04:27PM -0700, Bart Schaefer wrote:
> On the other hand, if you know version numbers of packages that are
> required, why haven't you listed them in the Makefile.PL prequisites?
Well, the reason for that is Net::DNS isn't required for SpamAssassin to
work, so it's not really a prerequisite like HTML::Parser or Digest::SHA1.
Arguably, the Makefile should throw a warning if it finds Net::DNS
available, but an old version, just to let you know that you won't be
able to use it.
"make test" doesn't check for version, but if you run one of the SpamAssassin
scripts, and the version isn't new enough, it will consider DNS to not be
available and auto-disable the DNSBLs. Running with debug would tell you:
"Net::DNS version is $Net::DNS::VERSION, but need 0.34"
This is actually what you're seeing, I believe. The test runs, "spamassassin"
can't use the old version so none of the rules hit and the test fails.
So the issue actually becomes: the tests validly fail if you try to test
DNSBLs -- they're just not verbose about what the problem is, which none of
them are really. There sometimes are logs in t/log, but dnsbl doesn't seem to
spit out debug information. :(
--
Randomly Generated Tagline:
"Redmond - Microsoft corp. announced this weekend that they will be
re-organizing into four functionally distinct divisions: Lying, Cheating,
Stealing, and Crashing. Wall Street analysts agree that this change will
better enable MSFT to achieve its strategic goals." - Unknown
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Bart Schaefer <ba...@gmail.com>.
On Sat, 28 Aug 2004 15:52:42 -0400, Theo Van Dinter <fe...@kluge.net> wrote:
> On Sat, Aug 28, 2004 at 12:43:25PM -0700, Bart Schaefer wrote:
> > I fixed this by upgrading with CPAN from Net::DNS 0.14 to the current
> > Net::DNS 0.48. This required me to first manually upgrade
>
> Note: the INSTALL document says that 0.34 or higher is required for UNIX.
Yes, I did see that, now that you mention it; but because "perl
Makefile.PL" did not complain about dependencies, I assumed I already
had a new enough version. An explicit mention that 5.6.1 might
require the upgrade could have sent me looking more closely.
On the other hand, if you know version numbers of packages that are
required, why haven't you listed them in the Makefile.PL prequisites?
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Theo Van Dinter <fe...@kluge.net>.
On Sat, Aug 28, 2004 at 12:43:25PM -0700, Bart Schaefer wrote:
> I fixed this by upgrading with CPAN from Net::DNS 0.14 to the current
> Net::DNS 0.48. This required me to first manually upgrade
Note: the INSTALL document says that 0.34 or higher is required for UNIX.
> With the latest Net::DNS, "make test" passes all tests. However, it
> might be worth noting somewhere in the install docs that Perl 5.6.1 is
> not sufficient without updated packages.
Yep -- that's why you need to read the documentation that comes with the
release. :)
--
Randomly Generated Tagline:
"A: You mean it's not due on Friday?
T: No, it's due two Mondays from now ... <slight pause>
A: Where's the remote?!?!?" - Alan and Theo about an OS1 Assignment
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Bart Schaefer <ba...@gmail.com>.
When I first tried to install this under perl 5.6.1, I got the same
DNSBL "Not found" test failures that were reported (by someone from
hostation.com, I don't have the message handy) for the 3.0.0-pre1
release. (I had not tried to install any of the previous pre-releases
myself.)
Here are the errors:
t/dnsbl..................... Not found: P_2 =
<dns:134.88.73.210.dnsbltest.spamassassin.org> [127.0.0.4]
Not found: P_7 =
<dns:134.88.73.210.sb.dnsbltest.spamassassin.org?type=TXT>
Not found: P_4 =
<dns:14.35.17.212.dnsbltest.spamassassin.org> [127.0.0.1, 127.0.0.1]
Not found: P_3 =
<dns:18.13.119.61.dnsbltest.spamassassin.org> [127.0.0.12]
Not found: P_5 =
<dns:226.149.120.193.dnsbltest.spamassassin.org> [127.0.0.1]
Not found: P_1 =
<dns:98.3.137.144.dnsbltest.spamassassin.org> [127.0.0.2]
Not found: P_6 = <dns:example.com.dnsbltest.spamassassin.org>
[127.0.0.2]
Not found: P_15 = DNSBL_RHS
Not found: P_17 = DNSBL_SB_FLOAT
Not found: P_18 = DNSBL_SB_STR
Not found: P_16 = DNSBL_SB_TIME
Not found: P_10 = DNSBL_TEST_DYNAMIC
t/dnsbl.....................NOK 11 Not found: P_12 = DNSBL_TEST_RELAY
t/dnsbl.....................NOK 12 Not found: P_11 = DNSBL_TEST_SPAM
t/dnsbl.....................NOK 13 Not found: P_8 = DNSBL_TEST_TOP
t/dnsbl.....................NOK 14 Not found: P_9 = DNSBL_TEST_WHITELIST
t/dnsbl.....................NOK 15 Not found: P_14 = DNSBL_TXT_RE
Not found: P_13 = DNSBL_TXT_TOP
t/dnsbl.....................FAILED tests 1-18
Failed 18/22 tests, 18.18% okay
I fixed this by upgrading with CPAN from Net::DNS 0.14 to the current
Net::DNS 0.48. This required me to first manually upgrade
Digest::SHA1 as well, because Net::DNS requires Digest::HMAC and the
dependencies in Digest::HMAC are incorrect with respect to the version
of SHA1 that it in turn requires.
With the latest Net::DNS, "make test" passes all tests. However, it
might be worth noting somewhere in the install docs that Perl 5.6.1 is
not sufficient without updated packages.
Re: SpamAssassin 3.0.0-rc2 RELEASE CANDIDATE available!
Posted by Bart Schaefer <ba...@gmail.com>.
When I first tried to install this under perl 5.6.1, I got the same
DNSBL "Not found" test failures that were reported (by someone from
hostation.com, I don't have the message handy) for the 3.0.0-pre1
release. (I had not tried to install any of the previous pre-releases
myself.)
Here are the errors:
t/dnsbl..................... Not found: P_2 =
<dns:134.88.73.210.dnsbltest.spamassassin.org> [127.0.0.4]
Not found: P_7 =
<dns:134.88.73.210.sb.dnsbltest.spamassassin.org?type=TXT>
Not found: P_4 =
<dns:14.35.17.212.dnsbltest.spamassassin.org> [127.0.0.1, 127.0.0.1]
Not found: P_3 =
<dns:18.13.119.61.dnsbltest.spamassassin.org> [127.0.0.12]
Not found: P_5 =
<dns:226.149.120.193.dnsbltest.spamassassin.org> [127.0.0.1]
Not found: P_1 =
<dns:98.3.137.144.dnsbltest.spamassassin.org> [127.0.0.2]
Not found: P_6 = <dns:example.com.dnsbltest.spamassassin.org>
[127.0.0.2]
Not found: P_15 = DNSBL_RHS
Not found: P_17 = DNSBL_SB_FLOAT
Not found: P_18 = DNSBL_SB_STR
Not found: P_16 = DNSBL_SB_TIME
Not found: P_10 = DNSBL_TEST_DYNAMIC
t/dnsbl.....................NOK 11 Not found: P_12 = DNSBL_TEST_RELAY
t/dnsbl.....................NOK 12 Not found: P_11 = DNSBL_TEST_SPAM
t/dnsbl.....................NOK 13 Not found: P_8 = DNSBL_TEST_TOP
t/dnsbl.....................NOK 14 Not found: P_9 = DNSBL_TEST_WHITELIST
t/dnsbl.....................NOK 15 Not found: P_14 = DNSBL_TXT_RE
Not found: P_13 = DNSBL_TXT_TOP
t/dnsbl.....................FAILED tests 1-18
Failed 18/22 tests, 18.18% okay
I fixed this by upgrading with CPAN from Net::DNS 0.14 to the current
Net::DNS 0.48. This required me to first manually upgrade
Digest::SHA1 as well, because Net::DNS requires Digest::HMAC and the
dependencies in Digest::HMAC are incorrect with respect to the version
of SHA1 that it in turn requires.
With the latest Net::DNS, "make test" passes all tests. However, it
might be worth noting somewhere in the install docs that Perl 5.6.1 is
not sufficient without updated packages.