You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Farid Izem <fa...@gmail.com> on 2005/03/06 19:27:45 UTC

Rule_Du_Jour.sh

Hi all,

I'm trying to make Rule_Du_Jour.sh spamassassin update rules script
working. I have successfully installed spamassassin 3.02 but the
Rule_Du_Jour.sh doesn't want to work. 

This is the debug output produces by the shell : 

bash ./Rule_Du_Jour.sh
exec: /usr/local/curl/bin/curl -w %{http_code} --compressed -O -R -s
-S -z /etc/mail/spamassassin/RulesDuJour/rules_du_jour
http://sandgnat.com/rdj/rules_du_jour 2>&1
curl_output: 304

------ TRIPWIRE ------
RULESET_NAME=TRIPWIRE
INDEX=0
CF_URL=http://www.rulesemporium.com/rules/99_FVGT_Tripwire.cf
CF_FILE=tripwire.cf
CF_NAME=TripWire
PARSE_NEW_VER_SCRIPT=perl -ne 'print if
/^\s*#.*(vers?|version|rev|revision)[:\.\s]*[0-9]/i;' | sort | tail -1
CF_MUNGE_SCRIPT=
Old 99_FVGT_Tripwire.cf already existed in /etc/mail/spamassassin/RulesDuJour...
Retrieving file from http://www.rulesemporium.com/rules/99_FVGT_Tripwire.cf...
exec: /usr/local/curl/bin/curl -w %{http_code} --compressed -O -R -s
-S -z /etc/mail/spamassassin/RulesDuJour/99_FVGT_Tripwire.cf
http://www.rulesemporium.com/rules/99_FVGT_Tripwire.cf 2>&1
curl_output: 304
99_FVGT_Tripwire.cf was up to date [skipped downloading of
http://www.rulesemporium.com/rules/99_FVGT_Tripwire.cf ] ...
Installing new ruleset from
/etc/mail/spamassassin/RulesDuJour/99_FVGT_Tripwire.cf.2
Installing new version...

TripWire has changed on ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version 1.18  More Typo's fixed.

------ EVILNUMBERS ------
RULESET_NAME=EVILNUMBERS
INDEX=8
CF_URL=http://www.rulesemporium.com/rules/evilnumbers.cf
CF_FILE=evilnumbers.cf
CF_NAME=EvilNumber
PARSE_NEW_VER_SCRIPT=perl -ne 'print if
/^\s*#.*(vers?|version|rev|revision)[:\.\s]*[0-9]/i;' | sort | tail -1
CF_MUNGE_SCRIPT=
Old evilnumbers.cf already existed in /etc/mail/spamassassin/RulesDuJour...
Retrieving file from http://www.rulesemporium.com/rules/evilnumbers.cf...
exec: /usr/local/curl/bin/curl -w %{http_code} --compressed -O -R -s
-S -z /etc/mail/spamassassin/RulesDuJour/evilnumbers.cf
http://www.rulesemporium.com/rules/evilnumbers.cf 2>&1
curl_output: 304
evilnumbers.cf was up to date [skipped downloading of
http://www.rulesemporium.com/rules/evilnumbers.cf ] ...
Installing new ruleset from /etc/mail/spamassassin/RulesDuJour/evilnumbers.cf.2
Installing new version...

EvilNumber has changed on ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version: 1.12s 

------ SARE_RANDOM ------
RULESET_NAME=SARE_RANDOM
INDEX=23
CF_URL=http://www.rulesemporium.com/rules/70_sare_random.cf
CF_FILE=70_sare_random.cf
CF_NAME=SARE Random Ruleset for SpamAssassin 2.5x and higher
PARSE_NEW_VER_SCRIPT=perl -ne 'print if
/^\s*#.*(vers?|version|rev|revision)[:\.\s]*[0-9]/i;' | sort | tail -1
CF_MUNGE_SCRIPT=
Old 70_sare_random.cf already existed in /etc/mail/spamassassin/RulesDuJour...
Retrieving file from http://www.rulesemporium.com/rules/70_sare_random.cf...
exec: /usr/local/curl/bin/curl -w %{http_code} --compressed -O -R -s
-S -z /etc/mail/spamassassin/RulesDuJour/70_sare_random.cf
http://www.rulesemporium.com/rules/70_sare_random.cf 2>&1
curl_output: 304
70_sare_random.cf was up to date [skipped downloading of
http://www.rulesemporium.com/rules/70_sare_random.cf ] ...
Installing new ruleset from
/etc/mail/spamassassin/RulesDuJour/70_sare_random.cf.2
Installing new version...

SARE Random Ruleset for SpamAssassin 2.5x and higher has changed on
ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version:  1.30.14
Attempting to --lint the rules.
No files updated; No restart required.





Rules Du Jour Run Summary:RulesDuJour Run Summary on
ABXSmtp1.dsi.abxlogistics.fr:

TripWire has changed on ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version 1.18  More Typo's fixed.

EvilNumber has changed on ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version: 1.12s 

SARE Random Ruleset for SpamAssassin 2.5x and higher has changed on
ABXSmtp1.dsi.abxlogistics.fr.
Version line: # Version:  1.30.14

***WARNING***: spamassassin -D --lint failed.
Rolling configuration files back, not restarting SpamAssassin.
Rollback command is:  mv -f /etc/mail/spamassassin/tripwire.cf
/etc/mail/spamassassin/RulesDuJour/99_FVGT_Tripwire.cf.2; rm -f
/etc/mail/spamassassin/tripwire.cf; mv -f
/etc/mail/spamassassin/evilnumbers.cf
/etc/mail/spamassassin/RulesDuJour/evilnumbers.cf.2; rm -f
/etc/mail/spamassassin/evilnumbers.cf; mv -f
/etc/mail/spamassassin/70_sare_random.cf
/etc/mail/spamassassin/RulesDuJour/70_sare_random.cf.2; rm -f
/etc/mail/spamassassin/70_sare_random.cf;

Lint output: debug: SpamAssassin version 3.0.2
debug: Score set 0 chosen.
debug: running in taint mode? yes
debug: Running in taint mode, removing unsafe env vars, and resetting PATH
debug: PATH included '/sbin', keeping.
debug: PATH included '/bin', keeping.
debug: PATH included '/usr/sbin', keeping.
debug: PATH included '/usr/bin', keeping.
debug: PATH included '/usr/games', keeping.
debug: PATH included '/usr/local/sbin', keeping.
debug: PATH included '/usr/local/bin', keeping.
debug: PATH included '/usr/X11R6/bin', keeping.
debug: PATH included '/root/bin', which doesn't exist, dropping.
debug: Final PATH set to:
/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/usr/X11R6/bin
debug: diag: module not installed: DBI ('require' failed)
debug: diag: module installed: DB_File, version 1.75
debug: diag: module installed: Digest::SHA1, version 2.10
debug: diag: module installed: IO::Socket::UNIX, version 1.20
debug: diag: module installed: MIME::Base64, version 2.21
debug: diag: module installed: Net::DNS, version 0.48
debug: diag: module not installed: Net::LDAP ('require' failed)
debug: diag: module not installed: Razor2::Client::Agent ('require' failed)
debug: diag: module not installed: Storable ('require' failed)
debug: diag: module installed: URI, version 1.27
debug: ignore: using a test message to lint rules
debug: using "/etc/mail/spamassassin/init.pre" for site rules init.pre
debug: config: read file /etc/mail/spamassassin/init.pre
debug: using "/usr/local/share/spamassassin" for default rules dir
debug: config: read file /usr/local/share/spamassassin/10_misc.cf
debug: config: read file /usr/local/share/spamassassin/20_anti_ratware.cf
debug: config: read file /usr/local/share/spamassassin/20_body_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_compensate.cf
debug: config: read file /usr/local/share/spamassassin/20_dnsbl_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_drugs.cf
debug: config: read file /usr/local/share/spamassassin/20_fake_helo_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_head_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_html_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_meta_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_phrases.cf
debug: config: read file /usr/local/share/spamassassin/20_porn.cf
debug: config: read file /usr/local/share/spamassassin/20_ratware.cf
debug: config: read file /usr/local/share/spamassassin/20_uri_tests.cf
debug: config: read file /usr/local/share/spamassassin/23_bayes.cf
debug: config: read file /usr/local/share/spamassassin/25_body_tests_es.cf
debug: config: read file /usr/local/share/spamassassin/25_hashcash.cf
debug: config: read file /usr/local/share/spamassassin/25_spf.cf
debug: config: read file /usr/local/share/spamassassin/25_uribl.cf
debug: config: read file /usr/local/share/spamassassin/30_text_de.cf
debug: config: read file /usr/local/share/spamassassin/30_text_fr.cf
debug: config: read file /usr/local/share/spamassassin/30_text_nl.cf
debug: config: read file /usr/local/share/spamassassin/30_text_pl.cf
debug: config: read file /usr/local/share/spamassassin/50_scores.cf
debug: config: read file /usr/local/share/spamassassin/60_whitelist.cf
debug: using "/etc/mail/spamassassin" for site rules dir
debug: config: read file /etc/mail/spamassassin/70_sare_random.cf
debug: config: read file /etc/mail/spamassassin/evilnumbers.cf
debug: config: read file /etc/mail/spamassassin/local-new.cf
debug: config: read file /etc/mail/spamassassin/local-sav.cf
debug: config: read file /etc/mail/spamassassin/local.cf
debug: config: read file /etc/mail/spamassassin/local_20050306.cf
debug: config: read file /etc/mail/spamassassin/tripwire.cf
debug: using "/root/.spamassassin" for user state dir
debug: using "/root/.spamassassin/user_prefs" for user prefs file
debug: config: read file /root/.spamassassin/user_prefs
debug: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from @INC
debug: plugin: registered Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4)
debug: plugin: loading Mail::SpamAssassin::Plugin::Hashcash from @INC
debug: plugin: registered Mail::SpamAssassin::Plugin::Hashcash=HASH(0x89ff8a0)
debug: plugin: loading Mail::SpamAssassin::Plugin::SPF from @INC
debug: plugin: registered Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50)
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4)
implements 'parse_config'
debug: plugin: Mail::SpamAssassin::Plugin::Hashcash=HASH(0x89ff8a0)
implements 'parse_config'
config: SpamAssassin failed to parse line, skipping: rewrite_subject         1
config: SpamAssassin failed to parse line, skipping: subject_tag      
      *****SPAM*****
config: SpamAssassin failed to parse line, skipping: use_terse_report        0
config: SpamAssassin failed to parse line, skipping: auto_learn              1
config: SpamAssassin failed to parse line, skipping: rewrite_subject         1
config: SpamAssassin failed to parse line, skipping: subject_tag      
      *****SPAM*****
config: SpamAssassin failed to parse line, skipping: use_terse_report        0
config: SpamAssassin failed to parse line, skipping: auto_learn              1
config: SpamAssassin failed to parse line, skipping: rewrite_subject         1
config: SpamAssassin failed to parse line, skipping: subject_tag      
      *****SPAM*****
config: SpamAssassin failed to parse line, skipping: use_terse_report        0
config: SpamAssassin failed to parse line, skipping: auto_learn              1
config: SpamAssassin failed to parse line, skipping: rewrite_subject         1
config: SpamAssassin failed to parse line, skipping: subject_tag      
      *****SPAM*****
config: SpamAssassin failed to parse line, skipping: use_terse_report        0
config: SpamAssassin failed to parse line, skipping: auto_learn              1
warning: score set for non-existent rule SARE_HEAD_XBEEN
warning: score set for non-existent rule SARE_FREE_WEBM_MYWAY
warning: score set for non-existent rule SARE_FREE_WEBM_LbPlugg
warning: score set for non-existent rule SARE_FREE_WEBM_Mailexc
warning: score set for non-existent rule SARE_FREE_WEBM_Uymail
warning: score set for non-existent rule SARE_FREE_WEBM_CZSEZNA
warning: score set for non-existent rule SARE_FREE_WEBM_OwnEm1
warning: score set for non-existent rule SARE_FREE_WEBM_OwnEm2
warning: score set for non-existent rule SARE_FREE_WEBM_Softhom
warning: score set for non-existent rule SARE_FREE_WEBM_123
warning: score set for non-existent rule SARE_FREE_WEBM_Netster
warning: score set for non-existent rule SARE_FREE_WEBM_FrYahoo
warning: score set for non-existent rule SARE_FREE_WEBM_NetFs
warning: score set for non-existent rule SARE_CHARSET_W1251
warning: score set for non-existent rule SARE_FREE_WEBM_MailD
warning: score set for non-existent rule SARE_WEOFFER
warning: score set for non-existent rule SARE_FREE_WEBM_Whoever
warning: score set for non-existent rule SARE_FREE_WEBM_Smapxsm
warning: score set for non-existent rule SARE_FREE_WEBM_Zwallet
warning: score set for non-existent rule SARE_FREE_WEBM_ZZa001
warning: score set for non-existent rule SARE_FREE_WEBM_ZIt001
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom01
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom02
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom03
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom04
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom05
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom06
warning: score set for non-existent rule SARE_FREE_WEBM_ZCom07
warning: score set for non-existent rule SARE_FREE_WEBM_FrVoila
warning: score set for non-existent rule SARE_FREE_WEBM_Dora
warning: score set for non-existent rule SARE_FREE_WEBM_Purin
warning: score set for non-existent rule SARE_FREE_WEBM_EsYahoo
warning: score set for non-existent rule SARE_FREE_WEBM_Jpop
warning: score set for non-existent rule SARE_FREE_WEBM_SURIML
warning: score set for non-existent rule SARE_FREE_WEBM_RuMail
warning: score set for non-existent rule SARE_FREE_WEBM_NetSafe
warning: score set for non-existent rule SARE_FREE_WEBM_EsTerra
warning: score set for non-existent rule SARE_FREE_WEBM_PlTenbi
warning: score set for non-existent rule SARE_FREE_WEBM_Iamfi
warning: score set for non-existent rule SARE_FREE_WEBM_WOWMAIL
warning: score set for non-existent rule SARE_FREE_WEBM_Kero
warning: score set for non-existent rule SARE_FREE_WEBM_Excite
warning: score set for non-existent rule SARE_HEAD_HDR_XWEBMTM
debug: using "/root/.spamassassin" for user state dir
debug: bayes: no dbs present, cannot tie DB R/O: /root/.spamassassin/bayes_toks
debug: Score set 1 chosen.
debug: ---- MIME PARSER START ----
debug: main message type: text/plain
debug: parsing normal part
debug: added part, type: text/plain
debug: ---- MIME PARSER END ----
debug: bayes: no dbs present, cannot tie DB R/O: /root/.spamassassin/bayes_toks
debug: metadata: X-Spam-Relays-Trusted: 
debug: metadata: X-Spam-Relays-Untrusted: 
debug: decoding: no encoding detected
debug: Loading languages file...
debug: Language possibly: en,sco
debug: metadata: X-Languages: en sco
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4)
implements 'parsed_metadata'
debug: is Net::DNS::Resolver available? yes
debug: Net::DNS version: 0.48
debug: trying (3) google.com...
debug: looking up NS for 'google.com'
debug: NS lookup of google.com succeeded => Dns available (set
dns_available to hardcode)
debug: is DNS available? 1
debug: URIDNSBL: domains to query: 
debug: all '*From' addrs: ignore@compiling.spamassassin.taint.org
debug: Running tests for priority: 0
debug: running header regexp tests; score so far=0
debug: registering glue method for check_for_spf_pass
(Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50))
debug: SPF: message was delivered entirely via trusted relays, not required
debug: all '*To' addrs: 
debug: registering glue method for check_hashcash_value
(Mail::SpamAssassin::Plugin::Hashcash=HASH(0x89ff8a0))
debug: registering glue method for check_for_spf_helo_fail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50))
debug: SPF: message was delivered entirely via trusted relays, not required
debug: registering glue method for check_for_spf_helo_pass
(Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50))
debug: registering glue method for check_hashcash_double_spend
(Mail::SpamAssassin::Plugin::Hashcash=HASH(0x89ff8a0))
debug: registering glue method for check_for_spf_softfail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50))
debug: registering glue method for check_for_spf_helo_softfail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x8a00f50))
debug: running body-text per-line regexp tests; score so far=-2.801
debug: running uri tests; score so far=-2.801
debug: registering glue method for check_uridnsbl
(Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4))
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4)
implements 'check_tick'
debug: running raw-body-text per-line regexp tests; score so far=-2.801
debug: running full-text regexp tests; score so far=-2.801
debug: DCCifd is not available: no r/w dccifd socket found.
debug: Running tests for priority: 500
debug: RBL: success for 1 of 1 queries
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x8a12ef4)
implements 'check_post_dnsbl'
debug: running meta tests; score so far=-2.801
debug: running header regexp tests; score so far=-1.053
debug: running body-text per-line regexp tests; score so far=-1.053
debug: running uri tests; score so far=-1.053
debug: running raw-body-text per-line regexp tests; score so far=-1.053
debug: running full-text regexp tests; score so far=-1.053
debug: Running tests for priority: 1000
debug: running meta tests; score so far=-1.053
debug: running header regexp tests; score so far=-1.053
debug: using "/root/.spamassassin" for user state dir
debug: lock: 9014 created
/root/.spamassassin/auto-whitelist.lock.ABXSmtp1.dsi.abxlogistics.fr.9014
debug: lock: 9014 trying to get lock on
/root/.spamassassin/auto-whitelist with 0 retries
debug: lock: 9014 link to /root/.spamassassin/auto-whitelist.lock: link ok
debug: Tie-ing to DB file R/W in /root/.spamassassin/auto-whitelist
debug: auto-whitelist (db-based):
ignore@compiling.spamassassin.taint.org|ip=none scores 0/0
debug: AWL active, pre-score: -1.053, autolearn score: -1.053, mean:
undef, IP: undef
debug: DB addr list: untie-ing and unlocking.
debug: DB addr list: file locked, breaking lock.
debug: unlock: 9014 unlink /root/.spamassassin/auto-whitelist.lock
debug: Post AWL score: -1.053
debug: running body-text per-line regexp tests; score so far=-1.053
debug: running uri tests; score so far=-1.053
debug: running raw-body-text per-line regexp tests; score so far=-1.053
debug: running full-text regexp tests; score so far=-1.053
debug: is spam? score=-1.053 required=7
debug: tests=ALL_TRUSTED,MISSING_DATE,MISSING_SUBJECT,NO_REAL_NAME
debug: subtests=__FAKE_XAUTH,__HAS_MSGID,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__NO_REAL_NAME,__REPLYTO_BOGUS,__SANE_MSGID,__SOMETHING,__UNUSABLE_MSGID
lint: 59 issues detected.  please rerun with debug enabled for more information.

Can someone explain to me how to solve all the config issues detected ?
(config: SpamAssassin failed to parse line)

Best Regards,

Farid.

Re: Rule_Du_Jour.sh

Posted by Loren Wilton <lw...@earthlink.net>.
> FI> Lint output: debug: SpamAssassin version 3.0.2
> FI> ...
> FI> config: SpamAssassin failed to parse line, skipping: rewrite_subject
1
> FI> config: SpamAssassin failed to parse line, skipping: subject_tag
*****SPAM*****
> FI> [...etc...]
>
> You have --lint errors here that are probably in your local.cf
>
> FI> Can someone explain to me how to solve all the config issues
> FI> detected ? (config: SpamAssassin failed to parse line)
>
> Have you checked the config docs?

A good suggestion.  Those two lines are SA 2.6 commands that have been
removed in 3.0.  This makes me suspect that other things might also not have
been correctly moved forward to 3.0.

        Loren


Re: Rule_Du_Jour.sh

Posted by Robert Menschel <Ro...@Menschel.net>.
Hello Farid,

Sunday, March 6, 2005, 10:27:45 AM, you wrote:

FI> This is the debug output produces by the shell :

FI> ***WARNING***: spamassassin -D --lint failed.

I'm not familiar with RDJ -- is the -D parameter there part of the
usual script, or something you added?  I was under the impression that
RDJ checked for any --lint output, and rolled back if it found any. -D
*will* generate output, and it might be causing RDJ to see problems
when there really aren't any.

FI> Rolling configuration files back, not restarting SpamAssassin.
FI> Rollback command is:  mv -f /etc/mail/spamassassin/tripwire.cf
FI> /etc/mail/spamassassin/RulesDuJour/99_FVGT_Tripwire.cf.2; rm -f
FI> /etc/mail/spamassassin/tripwire.cf; mv -f
FI> /etc/mail/spamassassin/evilnumbers.cf
FI> /etc/mail/spamassassin/RulesDuJour/evilnumbers.cf.2; rm -f
FI> /etc/mail/spamassassin/evilnumbers.cf; mv -f
FI> /etc/mail/spamassassin/70_sare_random.cf
FI> /etc/mail/spamassassin/RulesDuJour/70_sare_random.cf.2; rm -f
FI> /etc/mail/spamassassin/70_sare_random.cf;

The SARE files rolled back were tripwire, evilnumbers, and random. The
header config files aren't mentioned. I did an update to the header
files yesterday, and warning messages below reference some of those
rules. What is the status of the header files as far as your
configuration and your RDJ go?

FI> Lint output: debug: SpamAssassin version 3.0.2
FI> ...
FI> config: SpamAssassin failed to parse line, skipping: rewrite_subject         1
FI> config: SpamAssassin failed to parse line, skipping: subject_tag      *****SPAM*****
FI> [...etc...]

You have --lint errors here that are probably in your local.cf

Even though these errors have nothing to do with the files managed by
RDJ, they will cause RDJ failures.

FI> warning: score set for non-existent rule SARE_HEAD_XBEEN
FI> warning: score set for non-existent rule SARE_FREE_WEBM_MYWAY
FI> [...etc...]

These are the header rules I mentioned earlier. I don't see the header
files mentioned anywhere.  If you have scores set for these rules in
your local.cf, but are not including those files, that will also cause
your problem.

FI> Can someone explain to me how to solve all the config issues
FI> detected ? (config: SpamAssassin failed to parse line)

Have you checked the config docs?

Bob Menschel