You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by czar <cz...@czarism.com> on 2006/03/18 19:40:23 UTC
SA v3.1.1 --X-Spam Headers Gone & SA Results Broken
Hopefully some one could help me out with this SpamAssassin v3.1.1
upgrade issue.
Currently my Red Hat Linux server is using CPanel which automatically
updates via CPAN when a new release is announced (/scripts/cpup). Yet
for some reason this latest release of SA has caused the whole package
to become unstable. I second that v3.1.1 was //downloaded//
and //installed// I noticed that spam was no longer detected and all of
the X-Spam headers (except X-Spam-Checker-Version: SpamAssassin 3.1.1)
went missing.
== Logs and Messages ==
# This message is pure spam, yet the result is always 0!
$ cat /var/log/maillog
spamd: connection from localhost [127.0.0.1] at port 44453
spamd[8484]: spamd: setuid to john succeeded
spamd[8484]: spamd: processing message <000001c64ab8$0af71280
$242ea8c0@igf58> for john:32005
spamd[8484]: spamd: clean message (0.0/5.0) for john:32005 in 1.6
seconds, 4353 bytes.
spamd[8484]: spamd: result: . 0 -
scantime=1.6,size=4353,user=john,uid=32005,required_score=5.0,rhost=localhost,raddr=127.0.0.1,rport=44453,mid=<00...@igf58>,autolearn=ham
-----------------------------------
# GTUBE also fails
$ cat gtube.txt|spamassassin
X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on
zenith.serverorb.net
Subject: Test spam mail (GTUBE)
Message-ID: <GT...@example.net>
Date: Wed, 23 Jul 2003 23:30:00 +0200
From: Sender <se...@example.net>
To: Recipient <re...@example.net>
Precedence: junk
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
-----------------------------------
# I try the CPAN test install of Mail::SpamAssassin, this MIGHT be the
problem?
$ perl -MCPAN -e shell
$ test Mail::SpamAssassin
[...]
t ../masses/parse-rules-for-masses line 86, <IN> line 55.
Malformed UTF-8 character (unexpected non-continuation byte 0x2d,
immediately after start byte 0xea) in substitution (s///)
at ../masses/parse-rules-for-masses line 96, <IN> line 55.
[...]
t/prefs_include............. Not found: qp-encoded-desc = Invalid
Date: header =ae =af =b0 foo
t/prefs_include.............NOK 1# Failed test 1 in t/SATest.pm at line
592
t/prefs_include.............FAILED test 1
Failed 1/2 tests, 50.00% okay
-----------------------------------
# Oh, and here is --lint
$ spamassassin --lint -D
[17437] dbg: logger: adding facilities: all
[17437] dbg: logger: logging level is DBG
[17437] dbg: generic: SpamAssassin version 3.1.1
[17437] dbg: config: score set 0 chosen.
[17437] dbg: util: running in taint mode? yes
[17437] dbg: util: taint mode: deleting unsafe environment variables,
resetting PATH
[17437] dbg: util: PATH included '/usr/local/jdk/bin', which doesn't
exist, dropping
[17437] dbg: util: PATH included '/usr/kerberos/bin', keeping
[17437] dbg: util: PATH included '/usr/local/bin', keeping
[17437] dbg: util: PATH included '/bin', keeping
[17437] dbg: util: PATH included '/usr/bin', keeping
[17437] dbg: util: PATH included '/usr/X11R6/bin', keeping
[17437] dbg: util: PATH included '/usr/local/bin', keeping
[17437] dbg: util: PATH included '/usr/X11R6/bin', keeping
[17437] dbg: util: PATH included '/home/czar/bin', keeping
[17437] dbg: util: final PATH set
to: /usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/bin:/usr/X11R6/bin:/home/czar/bin
[17437] dbg: dns: is Net::DNS::Resolver available? yes
[17437] dbg: dns: Net::DNS version: 0.57
[17437] dbg: diag: perl platform: 5.008 linux
[17437] dbg: diag: module installed: Digest::SHA1, version 2.11
[17437] dbg: diag: module installed: Net::Ident, version 1.20
[17437] dbg: diag: module not installed: IO::Socket::INET6 ('require'
failed)
[17437] dbg: diag: module installed: IO::Socket::SSL, version 0.97
[17437] dbg: diag: module installed: Time::HiRes, version 1.87
[17437] dbg: diag: module installed: DBI, version 1.50
[17437] dbg: diag: module installed: Getopt::Long, version 2.32
[17437] dbg: diag: module installed: LWP::UserAgent, version 2.033
[17437] dbg: diag: module installed: HTTP::Date, version 1.47
[17437] dbg: diag: module installed: Archive::Tar, version 1.29
[17437] dbg: diag: module installed: IO::Zlib, version 1.04
[17437] dbg: diag: module installed: DB_File, version 1.806
[17437] dbg: diag: module installed: HTML::Parser, version 3.50
[17437] dbg: diag: module installed: MIME::Base64, version 3.07
[17437] dbg: diag: module installed: Net::DNS, version 0.57
[17437] dbg: diag: module installed: Net::SMTP, version 2.29
[17437] dbg: diag: module installed: Mail::SPF::Query, version 1.997
[17437] dbg: diag: module installed: IP::Country::Fast, version 309.002
[17437] dbg: diag: module not installed: Razor2::Client::Agent
('require' failed)
[17437] dbg: ignore: using a test message to lint rules
[17437] dbg: config: using "/etc/mail/spamassassin" for site rules pre
files
[17437] dbg: config: read file /etc/mail/spamassassin/init.pre
[17437] dbg: config: read file /etc/mail/spamassassin/v310.pre
[17437] dbg: config: using "/var/lib/spamassassin/3.001001" for sys
rules pre files
[17437] dbg: config: using "/var/lib/spamassassin/3.001001" for default
rules dir
[17437] dbg: config: using "/etc/mail/spamassassin" for site rules dir
[17437] dbg: config: read file /etc/mail/spamassassin/local.cf
[...]
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from
@INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x98b0c2c)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::Hashcash from
@INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::Hashcash=HASH(0x98cb66c)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::SPF from @INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::SPF=HASH(0x98f7d08)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::Pyzor from @INC
[17437] dbg: pyzor: network tests on, attempting Pyzor
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::Pyzor=HASH(0x9910188)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::SpamCop from
@INC
[17437] dbg: reporter: network tests on, attempting SpamCop
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::SpamCop=HASH(0x9927578)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::AWL from @INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::AWL=HASH(0x98e5770)
[17437] dbg: plugin: loading
Mail::SpamAssassin::Plugin::AutoLearnThreshold from @INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::AutoLearnThreshold=HASH(0x995c690)
[17437] dbg: plugin: loading
Mail::SpamAssassin::Plugin::WhiteListSubject from @INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::WhiteListSubject=HASH(0x9963bc4)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::MIMEHeader from
@INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::MIMEHeader=HASH(0x9971a44)
[17437] dbg: plugin: loading Mail::SpamAssassin::Plugin::ReplaceTags
from @INC
[17437] dbg: plugin: registered
Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0x99775d0)
[17437] dbg: plugin:
Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0x99775d0) implements
'finish_parsing_end'
[17437] dbg: replacetags: replacing tags
[17437] dbg: replacetags: done replacing tags
[17437] dbg: config: using "/home/czar/.spamassassin" for user state dir
[17437] dbg: bayes: tie-ing to DB file
R/O /home/czar/.spamassassin/bayes_toks
[17437] dbg: bayes: tie-ing to DB file
R/O /home/czar/.spamassassin/bayes_seen
[17437] dbg: bayes: found bayes db version 3
[17437] dbg: bayes: DB journal sync: last sync: 1142468080
[17437] dbg: config: using "/home/czar/.spamassassin" for user state dir
[17437] dbg: config: score set 3 chosen.
[17437] dbg: message: ---- MIME PARSER START ----
[17437] dbg: message: main message type: text/plain
[17437] dbg: message: parsing normal part
[17437] dbg: message: added part, type: text/plain
[17437] dbg: message: ---- MIME PARSER END ----
[17437] dbg: dns: name server: 70.84.208.228, family: 2, ipv6: 0
[17437] dbg: dns: testing resolver nameservers: 70.84.208.228,
70.84.208.229
[17437] dbg: dns: trying (3) gmx.net...
[17437] dbg: dns: looking up NS for 'gmx.net'
[17437] dbg: dns: NS lookup of gmx.net using 70.84.208.228 succeeded =>
DNS available (set dns_available to override)
[17437] dbg: dns: is DNS available? 1
[17437] dbg: metadata: X-Spam-Relays-Trusted:
[17437] dbg: metadata: X-Spam-Relays-Untrusted:
[17437] dbg: message: no encoding detected
[17437] dbg: plugin:
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x98b0c2c) implements
'parsed_metadata'
[17437] dbg: uridnsbl: domains to query:
[17437] dbg: plugin:
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x98b0c2c) implements
'check_post_dnsbl'
[17437] dbg: check: is spam? score=0 required=5
[17437] dbg: check: tests=
[17437] dbg: check: subtests=
--HELP?!
--
Regards,
Czar pHanGuYe
*****************************************************************
* Czar <cz...@czarism.com> Czarism Systems, Inc. *
* Encrypted E-mail Preferred PGP KeyID: 0x443C42A6 *
* The God is up high, the Czar is far away http://Czarism.com *
*****************************************************************
Re: SA v3.1.1 --X-Spam Headers Gone & SA Results Broken
Posted by Matthias Fuhrmann <Ma...@stud.uni-hannover.de>.
On Sat, 18 Mar 2006, czar wrote:
hI,
[...]
> # I try the CPAN test install of Mail::SpamAssassin, this MIGHT be the
> problem?
> $ perl -MCPAN -e shell
> $ test Mail::SpamAssassin
> [...]
> t ../masses/parse-rules-for-masses line 86, <IN> line 55.
> Malformed UTF-8 character (unexpected non-continuation byte 0x2d,
this reminds me to the perl 5.8 / utf-8 problem described in :
http://spamassassin.apache.org/dist/INSTALL
Note for Perl 5.8 Users (incl Red Hat 8)
----------------------------------------
Perl 5.8 now uses Unicode internally by default, which causes trouble for
SpamAssassin (and almost all other reasonably complex pieces of perl
code!).
[...]
Setting the LANG environment variable before any invocation of
SpamAssassin sometimes seems to help fix it, like so:
export LANG=en_US
dont blame me, if i'm wrong, just an idea :)
regards,
Matthias
Re: SA v3.1.1 --X-Spam Headers Gone & SA Results Broken
Posted by czar <cz...@czarism.com>.
On Sat, 2006-03-18 at 15:00 -0500, Theo Van Dinter wrote:
> On Sat, Mar 18, 2006 at 01:40:23PM -0500, czar wrote:
> > [17437] dbg: config: using "/var/lib/spamassassin/3.001001" for sys
> > rules pre files
> > [17437] dbg: config: using "/var/lib/spamassassin/3.001001" for default
> > rules dir
>
> It looks like you tried to run sa-update but it wasn't able to complete (no
> update rule files). You can remove the /var/lib/spamassassin directory and
> that'll fix that. Alternately, you could run "sa-update -D" and look at what
> is failing and work on fixing that instead/as well.
>
> (I'd suggest removing the directory and debugging with "sa-update -D --updatedir
> /tmp/updates" so the files goto a different area)
>
Theo,
You are the-man! After running ''sa-update -D'' I was able to see
exactly what was going wrong. The problem was a recently install
firewall (APF) was blocking port 8090 being used to ''wget'' the
updates. So I removed /var/lib/spamassassin (after a backup) and ran
''sa-update -D'' again to see all the lovely files downloading.
Next I run ''cat gtube.txt|spamassassin'' and FINALLY I see:
-----------------------------------------------------------------------
Subject: ***SPAM*** Test spam mail (GTUBE)
Date: Wed, 23 Jul 2003 23:30:00 +0200
Message-Id: <GT...@example.net>
X-Spam-Flag: YES
X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10)
X-Spam-Level: **************************************************
X-Spam-Status: Yes, score=997.4 required=5.0
tests=BAYES_00,GTUBE,NO_RECEIVED,
NO_RELAYS autolearn=no version=3.1.1
-----------------------------------------------------------------------
Thank you!
P.S. Don't forget to restart spamassassin, if with
cpanel /scripts/restartsrv_spamd did the trick.
--
Regards,
Czar pHanGuYe
*****************************************************************
* Czar <cz...@czarism.com> Czarism Systems, Inc. *
* Encrypted E-mail Preferred PGP KeyID: 0x443C42A6 *
* The God is up high, the Czar is far away http://Czarism.com *
*****************************************************************
Re: SA v3.1.1 --X-Spam Headers Gone & SA Results Broken
Posted by Theo Van Dinter <fe...@apache.org>.
On Sat, Mar 18, 2006 at 01:40:23PM -0500, czar wrote:
> [17437] dbg: config: using "/var/lib/spamassassin/3.001001" for sys
> rules pre files
> [17437] dbg: config: using "/var/lib/spamassassin/3.001001" for default
> rules dir
It looks like you tried to run sa-update but it wasn't able to complete (no
update rule files). You can remove the /var/lib/spamassassin directory and
that'll fix that. Alternately, you could run "sa-update -D" and look at what
is failing and work on fixing that instead/as well.
(I'd suggest removing the directory and debugging with "sa-update -D --updatedir
/tmp/updates" so the files goto a different area)
--
Randomly Generated Tagline:
"They won't run unix, but look on the bright side, they won't run
Windows either." - Martha Driscoll talking about 286s