You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by shane mullins <ts...@wise.k12.va.us> on 2004/12/17 21:08:24 UTC
Bayes still not working
I am still not getting any Bayes entries in my maillog. We are
running: OpenBSD 3.5, SA 3.0.2, amavisd-new, dcc and razor. With the
following info provided, does anyone have any ideas? I could provide
more details if needed.
Here is my local.cf references to Bayes:
use_bayes 1
bayes_auto_learn 1
bayes_path /var/amavisd/.spamassassin/bayes
When I run spamassassin -D --lint here is the output:
# spamassassin -D --lint
debug: SpamAssassin version 3.0.2
debug: Score set 0 chosen.
debug: running in taint mode? yes
debug: Running in taint mode, removing unsafe env vars, and resetting
PATH
debug: PATH included '/sbin', keeping.
debug: PATH included '/usr/sbin', keeping.
debug: PATH included '/bin', keeping.
debug: PATH included '/usr/bin', keeping.
debug: Final PATH set to: /sbin:/usr/sbin:/bin:/usr/bin
debug: diag: module not installed: DBI ('require' failed)
debug: diag: module installed: DB_File, version 1.807
debug: diag: module installed: Digest::SHA1, version 2.10
debug: diag: module installed: IO::Socket::UNIX, version 1.21
debug: diag: module installed: MIME::Base64, version 3.05
debug: diag: module installed: Net::DNS, version 0.48
debug: diag: module not installed: Net::LDAP ('require' failed)
debug: diag: module installed: Razor2::Client::Agent, version 2.61
debug: diag: module installed: Storable, version 2.08
debug: diag: module installed: URI, version 1.34
debug: ignore: using a test message to lint rules
debug: using "/etc/mail/spamassassin/init.pre" for site rules init.pre
debug: config: read file /etc/mail/spamassassin/init.pre
debug: using "/usr/local/share/spamassassin" for default rules dir
debug: config: read file /usr/local/share/spamassassin/10_misc.cf
debug: config: read file
/usr/local/share/spamassassin/20_anti_ratware.cf
debug: config: read file /usr/local/share/spamassassin/20_body_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_compensate.cf
debug: config: read file /usr/local/share/spamassassin/20_dnsbl_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_drugs.cf
debug: config: read file
/usr/local/share/spamassassin/20_fake_helo_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_head_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_html_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_meta_tests.cf
debug: config: read file /usr/local/share/spamassassin/20_phrases.cf
debug: config: read file /usr/local/share/spamassassin/20_porn.cf
debug: config: read file /usr/local/share/spamassassin/20_ratware.cf
debug: config: read file /usr/local/share/spamassassin/20_uri_tests.cf
debug: config: read file /usr/local/share/spamassassin/23_bayes.cf
debug: config: read file
/usr/local/share/spamassassin/25_body_tests_es.cf
debug: config: read file /usr/local/share/spamassassin/25_hashcash.cf
debug: config: read file /usr/local/share/spamassassin/25_spf.cf
debug: config: read file /usr/local/share/spamassassin/25_uribl.cf
debug: config: read file /usr/local/share/spamassassin/30_text_de.cf
debug: config: read file /usr/local/share/spamassassin/30_text_fr.cf
debug: config: read file /usr/local/share/spamassassin/30_text_nl.cf
debug: config: read file /usr/local/share/spamassassin/30_text_pl.cf
debug: config: read file /usr/local/share/spamassassin/50_scores.cf
debug: config: read file /usr/local/share/spamassassin/60_whitelist.cf
debug: using "/etc/mail/spamassassin" for site rules dir
debug: config: read file /etc/mail/spamassassin/local.cf
debug: using "/root/.spamassassin" for user state dir
debug: using "/root/.spamassassin/user_prefs" for user prefs file
debug: config: read file /root/.spamassassin/user_prefs
debug: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from @INC
debug: plugin: registered
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924)
debug: plugin: loading Mail::SpamAssassin::Plugin::Hashcash from @INC
debug: plugin: registered
Mail::SpamAssassin::Plugin::Hashcash=HASH(0x3cba8bc0)
debug: plugin: loading Mail::SpamAssassin::Plugin::SPF from @INC
debug: plugin: registered
Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308)
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924)
implements 'parse_config'
debug: plugin: Mail::SpamAssassin::Plugin::Hashcash=HASH(0x3cba8bc0)
implements 'parse_config'
debug: bayes: 23576 tie-ing to DB file R/O
/var/amavisd/.spamassassin/bayes_toks
debug: bayes: 23576 tie-ing to DB file R/O
/var/amavisd/.spamassassin/bayes_seen
debug: bayes: found bayes db version 3
debug: Score set 3 chosen.
debug: ---- MIME PARSER START ----
debug: main message type: text/plain
debug: parsing normal part
debug: added part, type: text/plain
debug: ---- MIME PARSER END ----
debug: metadata: X-Spam-Relays-Trusted:
debug: metadata: X-Spam-Relays-Untrusted:
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924)
implements 'parsed_metadata'
debug: dns_available set to yes in config file, skipping test
debug: decoding: no encoding detected
debug: URIDNSBL: domains to query:
debug: is Net::DNS::Resolver available? yes
debug: Net::DNS version: 0.48
debug: all '*From' addrs: ignore@compiling.spamassassin.taint.org
debug: Running tests for priority: 0
debug: running header regexp tests; score so far=0
debug: registering glue method for check_hashcash_double_spend
(Mail::SpamAssassin::Plugin::Hashcash=HASH(0x3cba8bc0))
debug: registering glue method for check_for_spf_helo_pass
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: SPF: message was delivered entirely via trusted relays, not
required
debug: registering glue method for check_hashcash_value
(Mail::SpamAssassin::Plugin::Hashcash=HASH(0x3cba8bc0))
debug: all '*To' addrs:
debug: registering glue method for check_for_spf_softfail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: SPF: message was delivered entirely via trusted relays, not
required
debug: registering glue method for check_for_spf_pass
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: registering glue method for check_for_spf_helo_softfail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: registering glue method for check_for_spf_fail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: registering glue method for check_for_spf_helo_fail
(Mail::SpamAssassin::Plugin::SPF=HASH(0x3cb88308))
debug: running body-text per-line regexp tests; score so far=0.619
debug: running uri tests; score so far=0.619
debug: registering glue method for check_uridnsbl
(Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924))
debug: bayes corpus size: nspam = 11217, nham = 3106
debug: tokenize: header tokens for *F = "U*ignore
D*compiling.spamassassin.taint.org D*spamassassin.taint.org D*taint.org
D*org"
debug: tokenize: header tokens for *m = " 1103315695 lint_rules "
debug: tokenize: header tokens for *RT = " "
debug: tokenize: header tokens for *RU = " "
debug: bayes token 'H*Ad:D*org' => 0.0105036777313484
debug: bayes token 'somewhat' => 0.0315481378182374
debug: bayes token 'H*F:D*org' => 0.132108368706952
debug: bayes token 'message' => 0.144404929302356
debug: bayes: score = 0.00188593021767242
debug: bayes: 23576 untie-ing
debug: bayes: 23576 untie-ing db_toks
debug: bayes: 23576 untie-ing db_seen
debug: Razor2 is available
debug: entering helper-app run mode
Razor-Log: Computed razorhome from env: /root/.razor
Razor-Log: Found razorhome: /root/.razor
Razor-Log: read_file: 16 items read from /root/.razor/razor-agent.conf
Dec 17 15:34:55.642487 check[23576]: [ 2] [bootup] Logging initiated
LogDebugLevel=9 to stdout
Dec 17 15:34:55.643080 check[23576]: [ 5] computed
razorhome=/root/.razor, conf=/root/.razor/razor-agent.conf,
ident=/root/.razor/identity-nkilgore@wise.k12.va.us
Dec 17 15:34:55.643373 check[23576]: [ 8] Client supported_engines: 4 8
Dec 17 15:34:55.643822 check[23576]: [ 8] prep_mail done: mail 1
headers=93, mime0=1376
Dec 17 15:34:55.644167 check[23576]: [ 5] read_file: 1 items read from
/root/.razor/servers.discovery.lst
Dec 17 15:34:55.644538 check[23576]: [ 5] read_file: 2 items read from
/root/.razor/servers.nomination.lst
Dec 17 15:34:55.644825 check[23576]: [ 5] read_file: 3 items read from
/root/.razor/servers.catalogue.lst
Dec 17 15:34:55.645143 check[23576]: [ 9] Assigning defaults to
folly.cloudmark.com
Dec 17 15:34:55.645389 check[23576]: [ 9] Assigning defaults to
joy.cloudmark.com
Dec 17 15:34:55.645561 check[23576]: [ 9] Assigning defaults to
wonder.cloudmark.com
Dec 17 15:34:55.645765 check[23576]: [ 9] Assigning defaults to
pride.cloudmark.com
Dec 17 15:34:55.645921 check[23576]: [ 9] Assigning defaults to
thrill.cloudmark.com
Dec 17 15:34:55.646644 check[23576]: [ 5] read_file: 12 items read from
/root/.razor/server.joy.cloudmark.com.conf
Dec 17 15:34:55.647103 check[23576]: [ 5] read_file: 12 items read from
/root/.razor/server.joy.cloudmark.com.conf
Dec 17 15:34:55.647537 check[23576]: [ 5] read_file: 13 items read from
/root/.razor/server.folly.cloudmark.com.conf
Dec 17 15:34:55.648064 check[23576]: [ 5] read_file: 13 items read from
/root/.razor/server.folly.cloudmark.com.conf
Dec 17 15:34:55.648639 check[23576]: [ 5] read_file: 16 items read from
/root/.razor/server.thrill.cloudmark.com.conf
Dec 17 15:34:55.649133 check[23576]: [ 5] read_file: 16 items read from
/root/.razor/server.thrill.cloudmark.com.conf
Dec 17 15:34:55.649723 check[23576]: [ 5] read_file: 17 items read from
/root/.razor/server.wonder.cloudmark.com.conf
Dec 17 15:34:55.650252 check[23576]: [ 5] read_file: 17 items read from
/root/.razor/server.wonder.cloudmark.com.conf
Dec 17 15:34:55.650471 check[23576]: [ 5] 142290 seconds before closest
server discovery
Dec 17 15:34:55.650755 check[23576]: [ 6] wonder.cloudmark.com is a
Catalogue Server srl 5050; computed min_cf=6, Server se: C8
Dec 17 15:34:55.650990 check[23576]: [ 8] Computed supported_engines: 4
8
Dec 17 15:34:55.651136 check[23576]: [ 8] Using next closest server
wonder.cloudmark.com:2703, cached info srl 5050
Dec 17 15:34:55.651306 check[23576]: [ 8] mail 1 has no subject
Dec 17 15:34:55.651632 check[23576]: [ 6] preproc: mail 1.0 went from
1376 bytes to 1339
Dec 17 15:34:55.651784 check[23576]: [ 6] computing sigs for mail 1.0,
len 1339
Dec 17 15:34:55.653259 check[23576]: [ 6] Engine (8) didn't produce a
signature for mail 1.0
Dec 17 15:34:55.653574 check[23576]: [ 6] skipping whitelist file
(empty?): /root/.razor/razor-whitelist
Dec 17 15:34:55.653738 check[23576]: [ 5] Connecting to
wonder.cloudmark.com ...
Dec 17 15:34:55.801566 check[23576]: [ 8] Connection established
Dec 17 15:34:55.801765 check[23576]: [ 4] wonder.cloudmark.com >> 36
server greeting: sn=C&srl=5050&a=l&a=cg&ep4=7542-10
Dec 17 15:34:55.802119 check[23576]: [ 4] wonder.cloudmark.com << 25
Dec 17 15:34:55.802284 check[23576]: [ 6] cn=razor-agents&cv=2.61
Dec 17 15:34:55.802503 check[23576]: [ 6] wonder.cloudmark.com is a
Catalogue Server srl 5050; computed min_cf=6, Server se: C8
Dec 17 15:34:55.802748 check[23576]: [ 8] Computed supported_engines: 4
8
Dec 17 15:34:55.802968 check[23576]: [ 8] mail 1.0 e4 sig:
xFaZIZUVHk90OQfARnenjx5BZTMA
Dec 17 15:34:55.803130 check[23576]: [ 5] mail 1.0 e8 got no sig
Dec 17 15:34:55.803251 check[23576]: [ 8] preparing 1 queries
Dec 17 15:34:55.803427 check[23576]: [ 8] sending 1 batches
Dec 17 15:34:55.803630 check[23576]: [ 4] wonder.cloudmark.com << 52
Dec 17 15:34:55.803723 check[23576]: [ 6]
a=c&e=4&ep4=7542-10&s=xFaZIZUVHk90OQfARnenjx5BZTMA
Dec 17 15:34:56.148727 check[23576]: [ 4] wonder.cloudmark.com >> 5
Dec 17 15:34:56.148846 check[23576]: [ 6] response to sent.2
p=0
Dec 17 15:34:56.149183 check[23576]: [ 6] mail 1.0 e=4
sig=xFaZIZUVHk90OQfARnenjx5BZTMA: sig not found.
Dec 17 15:34:56.149311 check[23576]: [ 7] method 4: mail 1.0:
no-contention part, spam=0
Dec 17 15:34:56.149452 check[23576]: [ 7] method 4: mail 1: all
non-contention parts not spam, mail not spam
Dec 17 15:34:56.149556 check[23576]: [ 3] mail 1 is not known spam.
Dec 17 15:34:56.149656 check[23576]: [ 5] disconnecting from server
wonder.cloudmark.com
Dec 17 15:34:56.149842 check[23576]: [ 4] wonder.cloudmark.com << 5
Dec 17 15:34:56.149931 check[23576]: [ 6] a=q
debug: Using results from Razor v2.61
debug: Found Razor2 part: part=0 engine=4 ct=0 cf=0
debug: leaving helper-app run mode
debug: Razor2 results: spam? 0 highest cf score: 0
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924)
implements 'check_tick'
debug: running raw-body-text per-line regexp tests; score so far=-1.98
debug: running full-text regexp tests; score so far=-1.98
debug: Razor2 is available
debug: DCCifd is not available: no r/w dccifd socket found.
debug: Current PATH is: /sbin:/usr/sbin:/bin:/usr/bin
debug: DCC is not available: no executable dccproc found.
debug: Running tests for priority: 500
debug: RBL: success for 0 of 1 queries
debug: DNS: timeout for ahbl after 15 seconds
debug: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x3c3ee924)
implements 'check_post_dnsbl'
debug: running meta tests; score so far=-1.98
debug: running header regexp tests; score so far=-0.754
debug: running body-text per-line regexp tests; score so far=-0.754
debug: running uri tests; score so far=-0.754
debug: running raw-body-text per-line regexp tests; score so far=-0.754
debug: running full-text regexp tests; score so far=-0.754
debug: Running tests for priority: 1000
debug: running meta tests; score so far=-0.754
debug: running header regexp tests; score so far=-0.754
debug: using "/root/.spamassassin" for user state dir
debug: lock: 23576 created
/root/.spamassassin/auto-whitelist.lock.mail4.wise.k12.va.us.23576
debug: lock: 23576 trying to get lock on
/root/.spamassassin/auto-whitelist with 0 retries
debug: lock: 23576 link to /root/.spamassassin/auto-whitelist.lock: link
ok
debug: Tie-ing to DB file R/W in /root/.spamassassin/auto-whitelist
debug: auto-whitelist (db-based):
ignore@compiling.spamassassin.taint.org|ip=none scores 0/0
debug: AWL active, pre-score: -0.754, autolearn score: -0.754, mean:
undef, IP: undef
debug: DB addr list: untie-ing and unlocking.
debug: DB addr list: file locked, breaking lock.
debug: unlock: 23576 unlink /root/.spamassassin/auto-whitelist.lock
debug: Post AWL score: -0.754
debug: running body-text per-line regexp tests; score so far=-0.754
debug: running uri tests; score so far=-0.754
debug: running raw-body-text per-line regexp tests; score so far=-0.754
debug: running full-text regexp tests; score so far=-0.754
debug: is spam? score=-0.754 required=5
debug: tests=BAYES_00,MISSING_HEADERS,MISSING_SUBJECT,NO_REAL_NAME
debug:
subtests=__HAS_MSGID,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__SANE_MSGID,__UN
USABLE_MSGID
Everything looks like a go, except I get no Bayes output. Any ideas?
Shane
Re: Bayes still not working
Posted by Theo Van Dinter <fe...@kluge.net>.
On Fri, Dec 17, 2004 at 03:08:24PM -0500, shane mullins wrote:
[...]
> debug: bayes: 23576 tie-ing to DB file R/O
> /var/amavisd/.spamassassin/bayes_toks
> debug: bayes: 23576 tie-ing to DB file R/O
> /var/amavisd/.spamassassin/bayes_seen
> debug: bayes: found bayes db version 3
> debug: Score set 3 chosen.
[...]
Ok, Bayes DB is available.
[...]
> debug: bayes corpus size: nspam = 11217, nham = 3106
> debug: tokenize: header tokens for *F = "U*ignore
> D*compiling.spamassassin.taint.org D*spamassassin.taint.org D*taint.org
> D*org"
> debug: tokenize: header tokens for *m = " 1103315695 lint_rules "
> debug: tokenize: header tokens for *RT = " "
> debug: tokenize: header tokens for *RU = " "
> debug: bayes token 'H*Ad:D*org' => 0.0105036777313484
> debug: bayes token 'somewhat' => 0.0315481378182374
> debug: bayes token 'H*F:D*org' => 0.132108368706952
> debug: bayes token 'message' => 0.144404929302356
> debug: bayes: score = 0.00188593021767242
> debug: bayes: 23576 untie-ing
> debug: bayes: 23576 untie-ing db_toks
> debug: bayes: 23576 untie-ing db_seen
[...]
Ok, Bayes only finds 4 tokens in common between message and header. Based on
that, the messages gets a 0.00188.... probability.
[...]
> debug: tests=BAYES_00,MISSING_HEADERS,MISSING_SUBJECT,NO_REAL_NAME
> debug:
> subtests=__HAS_MSGID,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__SANE_MSGID,__UN
> USABLE_MSGID
[...]
Message registers a BAYES_00 hit.
> Everything looks like a go, except I get no Bayes output. Any ideas?
?? What kind of Bayes output are you expecting? The debug output shows it's
working fine.
--
Randomly Generated Tagline:
Anyway, please don't anyone take offense at my free associations. Even
if they're true.
-- Larry Wall, 8th State of the Onion