You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by alexus <al...@gmail.com> on 2009/03/26 21:58:42 UTC
SpamAssassin is EXTREMLY slow
mx1# /usr/local/bin/spamd --allow-tell --vpopmail --username=spamd
--socketpath=/tmp/spamd.sock --debug all
[96985] dbg: logger: adding facilities: all
[96985] dbg: logger: logging level is DBG
[96985] dbg: logger: trying to connect to syslog/unix...
[96985] dbg: logger: opening syslog with unix socket
[96985] dbg: logger: successfully connected to syslog/unix
[96985] dbg: logger: successfully added syslog method
[96985] dbg: spamd: will perform setuids? 0
[96985] dbg: spamd: creating UNIX socket:
[96985] dbg: spamd: Listen: 128
[96985] dbg: spamd: Local: /tmp/spamd.sock
[96985] dbg: spamd: Type: 1
[96985] dbg: logger: adding facilities: all
[96985] dbg: logger: logging level is DBG
[96985] dbg: generic: SpamAssassin version 3.2.5
[96985] dbg: config: score set 0 chosen.
[96985] dbg: dns: no ipv6
[96985] dbg: dns: is Net::DNS::Resolver available? yes
[96985] dbg: dns: Net::DNS version: 0.65
[96985] dbg: spamd: Preloading modules with HOME=/tmp/spamd-96985-init
[96985] dbg: ignore: test message to precompile patterns and load modules
[96985] dbg: config: using "/etc/mail/spamassassin" for site rules pre files
[96985] dbg: config: read file /etc/mail/spamassassin/init.pre
[96985] dbg: config: read file /etc/mail/spamassassin/v310.pre
[96985] dbg: config: read file /etc/mail/spamassassin/v312.pre
[96985] dbg: config: read file /etc/mail/spamassassin/v320.pre
[96985] dbg: config: using "/usr/local/share/spamassassin" for sys
rules pre files
[96985] dbg: config: using "/usr/local/share/spamassassin" for default rules dir
[96985] dbg: config: read file /usr/local/share/spamassassin/10_default_prefs.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_advance_fee.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_body_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_compensate.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_dnsbl_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_drugs.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_dynrdns.cf
[96985] dbg: config: read file
/usr/local/share/spamassassin/20_fake_helo_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_head_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_html_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_imageinfo.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_meta_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_net_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_phrases.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_porn.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_ratware.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_uri_tests.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/20_vbounce.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/23_bayes.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_accessdb.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_antivirus.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_asn.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_dcc.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_dkim.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_domainkeys.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_hashcash.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_pyzor.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_razor2.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_replace.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_spf.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_textcat.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/25_uribl.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_de.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_fr.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_it.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_nl.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_pl.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/30_text_pt_br.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/50_scores.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/60_awl.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/60_shortcircuit.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/60_whitelist.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/60_whitelist_dk.cf
[96985] dbg: config: read file
/usr/local/share/spamassassin/60_whitelist_dkim.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/60_whitelist_spf.cf
[96985] dbg: config: read file
/usr/local/share/spamassassin/60_whitelist_subject.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/72_active.cf
[96985] dbg: config: read file /usr/local/share/spamassassin/72_removed.cf
[96985] dbg: config: using "/etc/mail/spamassassin" for site rules dir
[96985] dbg: config: read file /etc/mail/spamassassin/local.cf
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::Hashcash from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::SPF from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::Pyzor from @INC
[96985] dbg: pyzor: network tests on, attempting Pyzor
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::Razor2 from @INC
[96985] dbg: razor2: razor2 is not available
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::SpamCop from @INC
[96985] dbg: reporter: network tests on, attempting SpamCop
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::AWL from @INC
[96985] dbg: plugin: loading
Mail::SpamAssassin::Plugin::AutoLearnThreshold from @INC
[96985] dbg: plugin: loading
Mail::SpamAssassin::Plugin::WhiteListSubject from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::MIMEHeader from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::ReplaceTags from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::Check from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::HTTPSMismatch from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIDetail from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::Bayes from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::BodyEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::DNSEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::HTMLEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::HeaderEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::MIMEEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::RelayEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::WLBLEval from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::VBounce from @INC
[96985] dbg: plugin: loading Mail::SpamAssassin::Plugin::ImageInfo from @INC
[96985] dbg: rules: __MO_OL_9B90B merged duplicates: __MO_OL_C65FA
[96985] dbg: rules: __XM_OL_22B61 merged duplicates: __XM_OL_A842E
[96985] dbg: rules: __MO_OL_07794 merged duplicates: __MO_OL_8627E __MO_OL_F3B05
[96985] dbg: rules: __XM_OL_07794 merged duplicates: __XM_OL_25340
__XM_OL_3857F __XM_OL_4F240 __XM_OL_58CB5 __XM_OL_6554A __XM_OL_812FF
__XM_OL_C65FA __XM_OL_CF0C0 __XM_OL_F475E __XM_OL_F6D01
[96985] dbg: rules: FH_MSGID_01C67 merged duplicates: __MSGID_VGA
[96985] dbg: rules: FS_NEW_SOFT_UPLOAD merged duplicates: HS_SUBJ_NEW_SOFTWARE
[96985] dbg: rules: __FH_HAS_XMSMAIL merged duplicates: __HAS_MSMAIL_PRI
[96985] dbg: rules: __MO_OL_015D5 merged duplicates: __MO_OL_6554A
[96985] dbg: rules: __XM_OL_015D5 merged duplicates: __XM_OL_4BF4C
__XM_OL_4EEDB __XM_OL_5B79A __XM_OL_9B90B __XM_OL_ADFF7 __XM_OL_B30D1
__XM_OL_B4B40 __XM_OL_BC7E6 __XM_OL_F3B05 __XM_OL_FF5C8
[96985] dbg: rules: __MO_OL_91287 merged duplicates: __MO_OL_B30D1 __MO_OL_CF0C0
[96985] dbg: rules: KAM_STOCKOTC merged duplicates: KAM_STOCKTIP15
KAM_STOCKTIP20 KAM_STOCKTIP21 KAM_STOCKTIP4 KAM_STOCKTIP6
[96985] dbg: rules: __MO_OL_22B61 merged duplicates: __MO_OL_4F240 __MO_OL_ADFF7
[96985] dbg: rules: __MO_OL_812FF merged duplicates: __MO_OL_BC7E6
[96985] dbg: rules: __MO_OL_25340 merged duplicates: __MO_OL_4EEDB __MO_OL_7533E
[96985] dbg: rules: __MO_OL_58CB5 merged duplicates: __MO_OL_B4B40
[96985] dbg: rules: __DOS_HAS_ANY_URI merged duplicates: __HAS_ANY_URI
[96985] dbg: rules: AXB_RCVD_ZOOBSEND merged duplicates:
BROKEN_RATWARE_BOM CTYPE_001C_A DEAR_HOMEOWNER DIV_CENTER_A_HREF
DRUG_RA_PRICE FM_DDDD_TIMES_2 FM_SEX_HOSTDDDD HG_HORMONE HS_PHARMA_1
HS_UPLOADED_SOFTWARE OEBOUND STOX_RCVD_N_NN_N URIBL_RHS_ABUSE
URIBL_RHS_BOGUSMX URIBL_RHS_DSN URIBL_RHS_POST URIBL_RHS_TLD_WHOIS
URIBL_RHS_WHOIS URIBL_XS_SURBL URI_L_PHP XMAILER_MIMEOLE_OL_5E7ED
XMAILER_MIMEOLE_OL_C7C33 XMAILER_MIMEOLE_OL_D03AB X_LIBRARY
YOUR_CRD_RATING
[96985] dbg: rules: __MO_OL_72641 merged duplicates: __MO_OL_A842E
[96985] dbg: rules: __MO_OL_F475E merged duplicates: __MO_OL_FF5C8
[96985] dbg: rules: __MO_OL_4BF4C merged duplicates: __MO_OL_F6D01
[96985] dbg: conf: finish parsing
[96985] dbg: plugin:
Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0x80330fd10) implements
'finish_parsing_end', priority 0
[96985] dbg: replacetags: replacing tags
[96985] dbg: replacetags: done replacing tags
[96985] dbg: bayes: no dbs present, cannot tie DB R/O:
/tmp/spamd-96985-init/.spamassassin/bayes_toks
[96985] dbg: config: score set 1 chosen.
[96985] dbg: message: main message type: text/plain
[96985] dbg: message: ---- MIME PARSER START ----
[96985] dbg: message: parsing normal part
[96985] dbg: message: ---- MIME PARSER END ----
[96985] dbg: plugin:
Mail::SpamAssassin::Plugin::DNSEval=HASH(0x8035cd870) implements
'check_start', priority 0
[96985] dbg: bayes: no dbs present, cannot tie DB R/O:
/tmp/spamd-96985-init/.spamassassin/bayes_toks
[96985] dbg: plugin:
Mail::SpamAssassin::Plugin::Check=HASH(0x8035875d0) implements
'check_main', priority 0
[96985] dbg: conf: trusted_networks are not configured; it is
recommended that you configure trusted_networks manually
[96985] dbg: metadata: X-Spam-Relays-Trusted:
[96985] dbg: metadata: X-Spam-Relays-Untrusted:
[96985] dbg: metadata: X-Spam-Relays-Internal:
[96985] dbg: metadata: X-Spam-Relays-External:
[96985] dbg: message: no encoding detected
[96985] dbg: plugin:
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x80324cb10) implements
'parsed_metadata', priority 0
[96985] dbg: dns: is_dns_available() last checked 1238100715.0 seconds
ago; re-checking
[96985] dbg: dns: no ipv6
[96985] dbg: dns: is Net::DNS::Resolver available? yes
[96985] dbg: dns: Net::DNS version: 0.65
[96985] dbg: dns: name server: 208.67.222.222, LocalAddr: 0.0.0.0
[96985] dbg: dns: resolver socket rx buffer size is 42080 bytes
[96985] dbg: dns: testing resolver nameservers: 208.67.222.222, 208.67.220.220
[96985] dbg: dns: trying (3) apache.org...
[96985] dbg: dns: looking up NS for 'apache.org'
[96985] dbg: dns: NS lookup of apache.org using 208.67.222.222
succeeded => DNS available (set dns_available to override)
[96985] dbg: dns: name server: 208.67.220.220, LocalAddr: 0.0.0.0
[96985] dbg: dns: resolver socket rx buffer size is 42080 bytes
[96985] dbg: dns: trying (3) doubleclick.com...
[96985] dbg: dns: looking up NS for 'doubleclick.com'
[96985] dbg: dns: NS lookup of doubleclick.com using 208.67.220.220
succeeded => DNS available (set dns_available to override)
[96985] dbg: dns: name server: 208.67.220.220, LocalAddr: 0.0.0.0
[96985] dbg: dns: resolver socket rx buffer size is 42080 bytes
[96985] dbg: dns: NS list: 208.67.222.222, 208.67.220.220
[96985] dbg: dns: name server: 208.67.222.222, LocalAddr: 0.0.0.0
[96985] dbg: dns: resolver socket rx buffer size is 42080 bytes
[96985] dbg: dns: is DNS available? 1
[96985] dbg: uridnsbl: domains to query:
[96985] dbg: dns: checking RBL sa-other.bondedsender.org., set bsp-untrusted
[96985] dbg: dns: checking RBL plus.bondedsender.org., set ssc-firsttrusted
[96985] dbg: dns: checking RBL combined.njabl.org., set njabl
[96985] dbg: dns: checking RBL bl.spamcop.net., set spamcop
[96985] dbg: dns: checking RBL zen.spamhaus.org., set zen-lastexternal
[96985] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs-lastexternal
[96985] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs
[96985] dbg: dns: checking RBL zen.spamhaus.org., set zen-lastexternal
[96985] dbg: dns: checking RBL sa-accredit.habeas.com., set habeas-firsttrusted
[96985] dbg: dns: checking RBL list.dnswl.org., set dnswl-firsttrusted
[96985] dbg: dns: checking RBL list.dsbl.org., set dsbl-lastexternal
[96985] dbg: dns: checking RBL sa-trusted.bondedsender.org., set
bsp-firsttrusted
[96985] dbg: dns: checking RBL zen.spamhaus.org., set zen
[96985] dbg: dns: checking RBL iadb.isipp.com., set iadb-firsttrusted
[96985] dbg: check: running tests for priority: -1000
[96985] dbg: rules: running head tests; score so far=0
[96985] dbg: rules: compiled head tests
[96985] dbg: eval: all '*From' addrs: ignore@compiling.spamassassin.taint.org
[96985] dbg: eval: all '*To' addrs:
[96985] dbg: rules: running body tests; score so far=0
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=0
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=0
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=0
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=0
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: -950
[96985] dbg: rules: running head tests; score so far=0
[96985] dbg: rules: compiled head tests
[96985] dbg: rules: running body tests; score so far=0
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=0
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=0
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=0
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=0
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: -900
[96985] dbg: rules: running head tests; score so far=0
[96985] dbg: rules: compiled head tests
[96985] dbg: rules: running body tests; score so far=0
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=0
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=0
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=0
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=0
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: -400
[96985] dbg: rules: running head tests; score so far=0
[96985] dbg: rules: compiled head tests
[96985] dbg: rules: running body tests; score so far=0
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=0
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=0
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=0
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=0
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: 0
[96985] dbg: rules: running head tests; score so far=0
[96985] dbg: rules: compiled head tests
[96985] dbg: rules: ran header rule __MISSING_REF ======> got hit: "UNSET"
[96985] dbg: rules: ran header rule __MSGID_OK_HOST ======> got hit:
"@spamassassin_spamd_init>"
[96985] dbg: rules: ran header rule __MSGID_OK_DIGITS ======> got hit:
"1238100682"
[96985] dbg: rules: ran header rule __MSOE_MID_WRONG_CASE ======> got hit: "
[96985] dbg: rules: Message-Id: "
[96985] dbg: rules: ran header rule __HAS_MSGID ======> got hit: "<"
[96985] dbg: rules: ran header rule __SANE_MSGID ======> got hit:
"<12...@spamassassin_spamd_init>
[96985] dbg: rules: "
[96985] dbg: rules: ran header rule MISSING_DATE ======> got hit: "UNSET"
[96985] dbg: spf: checking to see if the message has a Received-SPF
header that we can use
[96985] dbg: spf: using Mail::SPF for SPF checks
[96985] dbg: spf: no suitable relay for spf use found, skipping SPF-helo check
[96985] dbg: spf: already checked for Received-SPF headers, proceeding
with DNS based checks
[96985] dbg: spf: no suitable relay for spf use found, skipping SPF check
[96985] dbg: rules: ran eval rule NO_RELAYS ======> got hit (1)
[96985] dbg: rules: ran eval rule __GATED_THROUGH_RCVD_REMOVER ======>
got hit (1)
[96985] dbg: spf: def_spf_whitelist_from: already checked spf and
didn't get pass, skipping whitelist check
[96985] dbg: rules: ran eval rule MISSING_HEADERS ======> got hit (1)
[96985] dbg: spf: whitelist_from_spf: already checked spf and didn't
get pass, skipping whitelist check
[96985] dbg: rules: running body tests; score so far=1.581
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: ran body rule __NONEMPTY_BODY ======> got hit: "I"
[96985] dbg: rules: running uri tests; score so far=1.581
[96985] dbg: rules: compiled uri tests
[96985] dbg: eval: stock info total: 0
[96985] dbg: rules: running rawbody tests; score so far=1.581
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=1.581
[96985] dbg: rules: compiled full tests
[96985] dbg: util: current PATH is:
/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin
[96985] dbg: pyzor: pyzor is not available: no pyzor executable found
[96985] dbg: pyzor: no pyzor found, disabling Pyzor
[96985] dbg: rules: running meta tests; score so far=1.581
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: 500
[96985] dbg: dns: harvest_dnsbl_queries
[96985] dbg: rules: running head tests; score so far=1.581
[96985] dbg: rules: compiled head tests
[96985] dbg: rules: running body tests; score so far=1.581
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=1.581
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=1.581
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=1.581
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=1.581
[96985] dbg: rules: meta test DIGEST_MULTIPLE has undefined dependency
'DCC_CHECK'
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: running tests for priority: 1000
[96985] dbg: rules: running head tests; score so far=2.865
[96985] dbg: rules: compiled head tests
[96985] dbg: locker: safe_lock: created
/tmp/spamd-96985-init/.spamassassin/auto-whitelist.lock.mx1.alexus.biz.96985
[96985] dbg: locker: safe_lock: trying to get lock on
/tmp/spamd-96985-init/.spamassassin/auto-whitelist with 0 retries
[96985] dbg: locker: safe_lock: link to
/tmp/spamd-96985-init/.spamassassin/auto-whitelist.lock: link ok
[96985] dbg: auto-whitelist: tie-ing to DB file of type DB_File R/W in
/tmp/spamd-96985-init/.spamassassin/auto-whitelist
[96985] dbg: auto-whitelist: db-based
ignore@compiling.spamassassin.taint.org|ip=none scores 0/0
[96985] dbg: auto-whitelist: AWL active, pre-score: 2.865, autolearn
score: 2.865, mean: undef, IP: undef
[96985] dbg: auto-whitelist: DB addr list: untie-ing and unlocking
[96985] dbg: auto-whitelist: DB addr list: file locked, breaking lock
[96985] dbg: locker: safe_unlock: unlink
/tmp/spamd-96985-init/.spamassassin/auto-whitelist.lock
[96985] dbg: auto-whitelist: post auto-whitelist score: 2.865
[96985] dbg: rules: running body tests; score so far=2.865
[96985] dbg: rules: compiled body tests
[96985] dbg: rules: running uri tests; score so far=2.865
[96985] dbg: rules: compiled uri tests
[96985] dbg: rules: running rawbody tests; score so far=2.865
[96985] dbg: rules: compiled rawbody tests
[96985] dbg: rules: running full tests; score so far=2.865
[96985] dbg: rules: compiled full tests
[96985] dbg: rules: running meta tests; score so far=2.865
[96985] dbg: rules: compiled meta tests
[96985] dbg: check: is spam? score=2.865 required=5
[96985] dbg: check:
tests=MISSING_DATE,MISSING_HEADERS,MISSING_SUBJECT,NO_RECEIVED,NO_RELAYS
[96985] dbg: check:
subtests=__GATED_THROUGH_RCVD_REMOVER,__HAS_MSGID,__MISSING_REF,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__MSOE_MID_WRONG_CASE,__NONEMPTY_BODY,__SANE_MSGID,__UNUSABLE_MSGID
[96985] dbg: learn: initializing learner
[96985] dbg: config: copying current conf to backup
[96985] info: spamd: server started on UNIX domain socket
/tmp/spamd.sock (running version 3.2.5)
[96985] info: spamd: server pid: 96985
[96985] info: spamd: server successfully spawned child process, pid 97034
[97034] dbg: prefork: sysread(8) not ready, wait max 300 secs
[96985] dbg: prefork: child 97034: entering state 0
[96985] dbg: prefork: new lowest idle kid: none
[96985] info: spamd: server successfully spawned child process, pid 97035
[97035] dbg: prefork: sysread(9) not ready, wait max 300 secs
[96985] dbg: prefork: child 97035: entering state 0
[96985] dbg: prefork: new lowest idle kid: none
[96985] dbg: prefork: child 97034: entering state 1
[96985] dbg: prefork: new lowest idle kid: 97034
[96985] dbg: prefork: child reports idle
[96985] dbg: prefork: child 97035: entering state 1
[96985] dbg: prefork: new lowest idle kid: 97034
[96985] dbg: prefork: child reports idle
[96985] info: prefork: child states: II
sending myself an email from my laptop...
[96985] dbg: prefork: ordered 97034 to accept
[97034] info: spamd: got connection over /tmp/spamd.sock
[96985] dbg: prefork: child 97034: entering state 2
[97034] warn: Use of uninitialized value $dir in scalar chomp at
/usr/local/bin/spamd line 2118, <GEN8> line 2.
[96985] dbg: prefork: new lowest idle kid: 97035
[97034] dbg: info: user has changed
[97034] dbg: bayes: no dbs present, cannot tie DB R/O:
/home/spamd/.spamassassin/bayes_toks
[97034] dbg: config: score set 1 chosen.
[97034] dbg: spamd: running as uid 58
[97034] dbg: dns: name server: 208.67.222.222, LocalAddr: 0.0.0.0
[97034] dbg: dns: resolver socket rx buffer size is 42080 bytes
[97034] dbg: message: main message type: text/plain
[97034] info: spamd: processing message
<20...@mbp.local> for simscan:58
[97034] dbg: bayes: no dbs present, cannot tie DB R/O:
/home/spamd/.spamassassin/bayes_toks
[97034] dbg: conf: trusted_networks are not configured; it is
recommended that you configure trusted_networks manually
[97034] dbg: received-header: parsed as [ ip=69.10.67.106 rdns=
helo=mbp.local by=alexus.org ident= envfrom= intl=0 id= auth= msa=0 ]
[97034] dbg: received-header: do not trust any hosts from here on
[97034] dbg: received-header: relay 69.10.67.106 trusted? no internal?
no msa? no
[97034] dbg: metadata: X-Spam-Relays-Trusted:
[97034] dbg: metadata: X-Spam-Relays-Untrusted: [ ip=69.10.67.106
rdns= helo=mbp.local by=alexus.org ident= envfrom= intl=0 id= auth=
msa=0 ]
[97034] dbg: metadata: X-Spam-Relays-Internal:
[97034] dbg: metadata: X-Spam-Relays-External: [ ip=69.10.67.106 rdns=
helo=mbp.local by=alexus.org ident= envfrom= intl=0 id= auth= msa=0 ]
[97034] dbg: message: ---- MIME PARSER START ----
[97034] dbg: message: parsing normal part
[97034] dbg: message: ---- MIME PARSER END ----
[97034] dbg: message: no encoding detected
[97034] dbg: uridnsbl: domains to query:
[97034] dbg: dns: checking RBL sa-other.bondedsender.org., set bsp-untrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs:
[97034] dbg: dns: checking RBL plus.bondedsender.org., set ssc-firsttrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.plus.bondedsender.org. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.plus.bondedsender.org. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL combined.njabl.org., set njabl
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.combined.njabl.org. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.combined.njabl.org. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL bl.spamcop.net., set spamcop
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS TXT query for
106.67.10.69.bl.spamcop.net. in background
[97034] dbg: async: starting: DNSBL-TXT,
dns:TXT:106.67.10.69.bl.spamcop.net. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL zen.spamhaus.org., set zen-lastexternal
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.zen.spamhaus.org. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.zen.spamhaus.org. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs-lastexternal
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.dnsbl.sorbs.net. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.dnsbl.sorbs.net. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: checking RBL zen.spamhaus.org., set zen-lastexternal
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: checking RBL sa-accredit.habeas.com., set habeas-firsttrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.sa-accredit.habeas.com. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.sa-accredit.habeas.com. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL list.dnswl.org., set dnswl-firsttrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.list.dnswl.org. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.list.dnswl.org. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL list.dsbl.org., set dsbl-lastexternal
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS TXT query for
106.67.10.69.list.dsbl.org. in background
[97034] dbg: async: starting: DNSBL-TXT,
dns:TXT:106.67.10.69.list.dsbl.org. (timeout 15.0s, min 3.0s)
[97034] dbg: dns: checking RBL sa-trusted.bondedsender.org., set
bsp-firsttrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS TXT query for
106.67.10.69.sa-trusted.bondedsender.org. in background
[97034] dbg: async: starting: DNSBL-TXT,
dns:TXT:106.67.10.69.sa-trusted.bondedsender.org. (timeout 15.0s, min
3.0s)
[97034] dbg: dns: checking RBL zen.spamhaus.org., set zen
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: checking RBL iadb.isipp.com., set iadb-firsttrusted
[97034] dbg: dns: IPs found: full-external: 69.10.67.106 untrusted:
69.10.67.106 originating:
[97034] dbg: dns: only inspecting the following IPs: 69.10.67.106
[97034] dbg: dns: launching DNS A query for
106.67.10.69.iadb.isipp.com. in background
[97034] dbg: async: starting: DNSBL-A,
dns:A:106.67.10.69.iadb.isipp.com. (timeout 15.0s, min 3.0s)
[97034] dbg: check: running tests for priority: -1000
[97034] dbg: async: select found 9 responses ready (t.o.=0.0)
[97034] dbg: async: completed in 6.405 s: DNSBL-A,
dns:A:106.67.10.69.sa-accredit.habeas.com.
[97034] dbg: async: completed in 2.564 s: DNSBL-TXT,
dns:TXT:106.67.10.69.sa-trusted.bondedsender.org.
[97034] dbg: async: completed in 10.504 s: DNSBL-A,
dns:A:106.67.10.69.zen.spamhaus.org.
[97034] dbg: async: completed in 9.223 s: DNSBL-A,
dns:A:106.67.10.69.dnsbl.sorbs.net.
[97034] dbg: async: completed in 11.784 s: DNSBL-TXT,
dns:TXT:106.67.10.69.bl.spamcop.net.
[97034] dbg: async: completed in 0.515 s: DNSBL-A,
dns:A:106.67.10.69.iadb.isipp.com.
[97034] dbg: async: completed in 5.125 s: DNSBL-A,
dns:A:106.67.10.69.list.dnswl.org.
[97034] dbg: async: completed in 13.065 s: DNSBL-A,
dns:A:106.67.10.69.combined.njabl.org.
[97034] dbg: async: completed in 14.345 s: DNSBL-A,
dns:A:106.67.10.69.plus.bondedsender.org.
[97034] dbg: async: queries completed: 9, started: 0
[97034] dbg: async: queries active: DNSBL-TXT=1, all expired at Thu
Mar 26 20:53:44 2009
[97034] dbg: dns: harvested completed queries
[97034] dbg: rules: running head tests; score so far=0
[97034] dbg: async: select found 1 responses ready (t.o.=0.0)
[97034] dbg: async: completed in 7.431 s: DNSBL-TXT,
dns:TXT:106.67.10.69.list.dsbl.org.
[97034] dbg: dns: harvested completed queries
[97034] dbg: eval: all '*From' addrs: alexus@mbp.local
[97034] dbg: eval: all '*To' addrs: postmaster@8au.net
[97034] dbg: rules: running body tests; score so far=0
[97034] dbg: rules: running uri tests; score so far=0
[97034] dbg: rules: running rawbody tests; score so far=0
[97034] dbg: rules: running full tests; score so far=0
[97034] dbg: rules: running meta tests; score so far=0
[97034] dbg: check: running tests for priority: -950
[97034] dbg: rules: running head tests; score so far=0
[97034] dbg: rules: running body tests; score so far=0
[97034] dbg: rules: running uri tests; score so far=0
[97034] dbg: rules: running rawbody tests; score so far=0
[97034] dbg: rules: running full tests; score so far=0
[97034] dbg: rules: running meta tests; score so far=0
[97034] dbg: check: running tests for priority: -900
[97034] dbg: rules: running head tests; score so far=0
[97034] dbg: rules: running body tests; score so far=0
[97034] dbg: rules: running uri tests; score so far=0
[97034] dbg: rules: running rawbody tests; score so far=0
[97035] dbg: prefork: periodic ping from spamd parent
[97034] dbg: rules: running full tests; score so far=0
[97035] dbg: prefork: sysread(9) not ready, wait max 300 secs
[97034] dbg: rules: running meta tests; score so far=0
[97034] dbg: check: running tests for priority: -400
[97034] dbg: rules: running head tests; score so far=0
[97034] dbg: rules: running body tests; score so far=0
[97034] dbg: rules: running uri tests; score so far=0
[97034] dbg: rules: running rawbody tests; score so far=0
[97034] dbg: rules: running full tests; score so far=0
[97034] dbg: rules: running meta tests; score so far=0
[97034] dbg: check: running tests for priority: 0
[97034] dbg: rules: running head tests; score so far=0
[97034] dbg: rules: ran header rule __RDNS_NONE ======> got hit: "[
ip=69.10.67.106 rdns= "
[97034] dbg: rules: ran header rule __LAST_UNTRUSTED_RELAY_NO_AUTH
======> got hit: "[ ip=69.10.67.106 rdns= helo=mbp.local by=alexus.org
ident= envfrom= intl=0 id= auth= "
[97034] dbg: rules: ran header rule __DOS_SINGLE_EXT_RELAY ======> got
hit: "[ ip=69.10.67.106 rdns= helo=mbp.local by=alexus.org ident=
envfrom= intl=0 id= auth= msa=0 ]"
[97034] dbg: rules: ran header rule __MISSING_REF ======> got hit: "UNSET"
[97034] dbg: rules: ran header rule __NAKED_TO ======> got hit:
"postmaster@8au.net"
[97034] dbg: rules: ran header rule __HAS_RCVD ======> got hit: "f"
[97034] dbg: rules: ran header rule __DOS_RCVD_THU ======> got hit: " Thu, "
[97034] dbg: rules: ran header rule __TOCC_EXISTS ======> got hit: "p"
[97034] dbg: rules: ran header rule __MSGID_OK_HOST ======> got hit:
"@mbp.local>"
[97034] dbg: rules: ran header rule __MSGID_OK_DIGITS ======> got hit:
"2009032620"
[97034] dbg: rules: ran header rule __MSOE_MID_WRONG_CASE ======> got hit: "
[97034] dbg: rules: Message-Id: "
[97034] dbg: rules: ran header rule __HAS_MSGID ======> got hit: "<"
[97034] dbg: rules: ran header rule __SANE_MSGID ======> got hit:
"<20...@mbp.local>
[97034] dbg: rules: "
[97034] dbg: spf: checking to see if the message has a Received-SPF
header that we can use
[97034] dbg: spf: checking HELO (helo=mbp.local, ip=69.10.67.106)
[97034] dbg: spf: query for /69.10.67.106/mbp.local: result: none,
comment: , text: No applicable sender policy available
[97034] dbg: spf: already checked for Received-SPF headers, proceeding
with DNS based checks
[97034] dbg: spf: cannot get Envelope-From, cannot use SPF
[97034] dbg: spf: def_spf_whitelist_from: already checked spf and
didn't get pass, skipping whitelist check
[97034] dbg: spf: whitelist_from_spf: already checked spf and didn't
get pass, skipping whitelist check
[97034] dbg: rules: running body tests; score so far=0
[97034] dbg: rules: ran body rule __NONEMPTY_BODY ======> got hit: "1"
[97034] dbg: rules: running uri tests; score so far=0
[97034] dbg: eval: stock info total: 0
[97034] dbg: rules: ran eval rule TVD_SPACE_RATIO ======> got hit (1)
[97034] dbg: rules: running rawbody tests; score so far=2.899
[97034] dbg: rules: running full tests; score so far=2.899
[97034] dbg: pyzor: pyzor is not available: no pyzor executable found
[97034] dbg: pyzor: no pyzor found, disabling Pyzor
[97034] dbg: rules: running meta tests; score so far=2.899
[97034] dbg: check: running tests for priority: 500
[97034] dbg: dns: harvest_dnsbl_queries
[97034] dbg: async: timing: 0.515 . dns:A:106.67.10.69.iadb.isipp.com.
[97034] dbg: async: timing: 2.564 .
dns:TXT:106.67.10.69.sa-trusted.bondedsender.org.
[97034] dbg: async: timing: 5.125 . dns:A:106.67.10.69.list.dnswl.org.
[97034] dbg: async: timing: 6.405 . dns:A:106.67.10.69.sa-accredit.habeas.com.
[97034] dbg: async: timing: 7.431 . dns:TXT:106.67.10.69.list.dsbl.org.
[97034] dbg: async: timing: 9.223 . dns:A:106.67.10.69.dnsbl.sorbs.net.
[97034] dbg: async: timing: 10.504 . dns:A:106.67.10.69.zen.spamhaus.org.
[97034] dbg: async: timing: 11.784 . dns:TXT:106.67.10.69.bl.spamcop.net.
[97034] dbg: async: timing: 13.065 . dns:A:106.67.10.69.combined.njabl.org.
[97034] dbg: async: timing: 14.345 . dns:A:106.67.10.69.plus.bondedsender.org.
[97034] dbg: rules: running head tests; score so far=2.899
[97034] dbg: rules: running body tests; score so far=2.899
[97034] dbg: rules: running uri tests; score so far=2.899
[97034] dbg: rules: running rawbody tests; score so far=2.899
[97034] dbg: rules: running full tests; score so far=2.899
[97034] dbg: rules: running meta tests; score so far=2.899
[97034] dbg: check: running tests for priority: 1000
[97034] dbg: rules: running head tests; score so far=4.284
[97034] dbg: locker: safe_lock: created
/home/spamd/.spamassassin/auto-whitelist.lock.mx1.alexus.biz.97034
[97034] dbg: locker: safe_lock: trying to get lock on
/home/spamd/.spamassassin/auto-whitelist with 0 retries
[97034] dbg: locker: safe_lock: link to
/home/spamd/.spamassassin/auto-whitelist.lock: link ok
[97034] dbg: auto-whitelist: tie-ing to DB file of type DB_File R/W in
/home/spamd/.spamassassin/auto-whitelist
[97034] dbg: auto-whitelist: db-based alexus@mbp.local|ip=69.10 scores 18/77.112
[97034] dbg: auto-whitelist: AWL active, pre-score: 4.284, autolearn
score: 4.284, mean: 4.284, IP: 69.10.67.106
[97034] dbg: auto-whitelist: add_score: new count: 19, new totscore: 81.396
[97034] dbg: auto-whitelist: DB addr list: untie-ing and unlocking
[97034] dbg: auto-whitelist: DB addr list: file locked, breaking lock
[97034] dbg: locker: safe_unlock: unlink
/home/spamd/.spamassassin/auto-whitelist.lock
[97034] dbg: auto-whitelist: post auto-whitelist score: 4.284
[97034] dbg: rules: running body tests; score so far=4.284
[97034] dbg: rules: running uri tests; score so far=4.284
[97034] dbg: rules: running rawbody tests; score so far=4.284
[97034] dbg: rules: running full tests; score so far=4.284
[97034] dbg: rules: running meta tests; score so far=4.284
[97034] dbg: plugin:
Mail::SpamAssassin::Plugin::AutoLearnThreshold=HASH(0x80330b018)
implements 'autolearn_discriminator', priority 0
[97034] dbg: learn: auto-learn: currently using scoreset 1
[97034] dbg: learn: auto-learn: message score: 4.284, computed score
for autolearn: 4.284
[97034] dbg: learn: auto-learn? ham=0.1, spam=12, body-points=4.284,
head-points=4.284, learned-points=0
[97034] dbg: learn: auto-learn? no: inside auto-learn thresholds, not
considered ham or spam
[97034] dbg: check: is spam? score=4.284 required=5
[97034] dbg: check: tests=MISSING_SUBJECT,RDNS_NONE,TVD_SPACE_RATIO
[97034] dbg: check:
subtests=__DOS_RCVD_THU,__DOS_SINGLE_EXT_RELAY,__HAS_MSGID,__HAS_RCVD,__LAST_UNTRUSTED_RELAY_NO_AUTH,__MISSING_REF,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__MSOE_MID_WRONG_CASE,__NAKED_TO,__NONEMPTY_BODY,__RDNS_NONE,__SANE_MSGID,__TOCC_EXISTS
[97034] info: spamd: clean message (4.3/5.0) for simscan:58 in 53.8
seconds, 366 bytes.
[97034] info: spamd: result: . 4 -
MISSING_SUBJECT,RDNS_NONE,TVD_SPACE_RATIO
scantime=53.8,size=366,user=simscan,uid=58,required_score=5.0,rhost=localhost,raddr=127.0.0.1,rport=/tmp/spamd.sock,mid=<20...@mbp.local>,autolearn=no
[97034] dbg: config: copying current conf from backup
[97034] dbg: prefork: periodic ping from spamd parent
[96985] dbg: prefork: child 97034: entering state 1
[96985] dbg: prefork: new lowest idle kid: 97034
[97034] dbg: prefork: sysread(8) not ready, wait max 300 secs
[96985] dbg: prefork: child reports idle
[96985] info: prefork: child states: II
[97035] dbg: prefork: periodic ping from spamd parent
[97034] dbg: prefork: periodic ping from spamd parent
[97035] dbg: prefork: sysread(9) not ready, wait max 300 secs
[97034] dbg: prefork: sysread(8) not ready, wait max 300 secs
--
http://alexus.org/
Re: SpamAssassin is EXTREMLY slow
Posted by RW <rw...@googlemail.com>.
On Fri, 27 Mar 2009 23:59:10 +0200
"Jari Fredriksson" <ja...@iki.fi> wrote:
>
> Yes, it is terribly slow.
>
> I just hope that as good as SA is will be written in some programming
> language, and not scripting language.
IIRC it spends most of its time inside regex library functions which
are written in C.
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by DAve <da...@pixelhammer.com>.
alexus wrote:
> On Wed, Apr 1, 2009 at 4:49 PM, David Morton <mo...@dgrmm.net> wrote:
>> Karsten Bräckelmann wrote:
>>> On Fri, 2009-03-27 at 23:59 +0200, Jari Fredriksson wrote:
>>>> I just hope that as good as SA is will be written in some programming
>>>> language, and not scripting language. Even Java would be better.
>>> Dude, you just lost a credit point... ;)
>>>
>>> Everyone, if you feel the urge to contribute to this thread any further,
>>> please first *do* check the list archives -- this pointless thread comes
>>> up like once a year. If you believe you can come up with a convincing
>>> argument that has *not* been mentioned and turned down before, and which
>>> takes "active contributors code Perl" into account... please try.
>> Agreed. Anytime anyone starts talking about speed and languages, I roll
>> my eyes. Seriously, unless you are a developer and have actually run
>> code through a profiler to know what areas are running "slow", you are
>> not qualified to make such statements.
>>
>> If you *have* run the code through a profiler and can prove that a
>> majority of time is spent inside a language construct and not on I/O or
>> a bad algorithm, then you are qualified... to submit a bug report to the
>> language developers so they can fix it. Anything else is just bogus.
>>
>>
>
> okay, we like really far away from original thread, i said that
> SpamAssassin runs really slow for me and on top of that I even found
> which plugin causing that, which is this:
>
> loadplugin Mail::SpamAssassin::Plugin::DNSEval
>
> I had to disable it, if someone can suggest something in order to make
> it work faster i'm all ears
>
We run four servers with SA and check every message. After blocking, we
see 30k to 50k a day actually make it to SA testing. Each of those
servers use a local DNS cache witch is cycling around every 15 minutes.
The local DNS cache is reaching out to a common DNS cache inside the
same network which is doing all the outside DNS lookups for mail
services. The common cache is cycling around once an hour.
SA routinely takes less than a second per message with several URLs in
the message. Does that help?
DAve
--
"Posterity, you will know how much it cost the present generation to
preserve your freedom. I hope you will make good use of it. If you
do not, I shall repent in heaven that ever I took half the pains to
preserve it." John Quincy Adams
http://appleseedinfo.org
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Thu, 2 Apr 2009, Benny Pedersen wrote:
> On Wed, April 1, 2009 23:22, alexus wrote:
>> loadplugin Mail::SpamAssassin::Plugin::DNSEval
>>
>> I had to disable it, if someone can suggest something in order to
>> make it work faster i'm all ears
>
> apt-get install bind
> change /etc/resolv.conf to have just
> nameserver 127.0.0.1
We've already determined that a local nameserver is in use and is
responding quickly to non-SA requests.
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
W-w-w-w-w-where did he learn to n-n-negotiate like that?
-----------------------------------------------------------------------
71 days since Obama's inauguration and still no unicorn!
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by Benny Pedersen <me...@junc.org>.
On Wed, April 1, 2009 23:22, alexus wrote:
> loadplugin Mail::SpamAssassin::Plugin::DNSEval
>
> I had to disable it, if someone can suggest something in order to
> make it work faster i'm all ears
apt-get install bind
change /etc/resolv.conf to have just
nameserver 127.0.0.1
restart bind
test with
dig google.com
is 127.0.0.1 listed as nameserver ?, then its solved
if youi use other os then you are on your own :)
--
http://localhost/ 100% uptime and 100% mirrored :)
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Wed, 1 Apr 2009, Chris wrote:
> Using a local caching nameserver with 127.0.0.1 as my nameserver, BIND
> 9.5.0-P2, Net::DNS 0.65. I notice that the slowest one shows:
>
> [14035] dbg: dns: Net::DNS version: 0.63
>
> and the faster one shows:
>
> [17352] dbg: dns: Net::DNS version: 0.65
>
> Why the difference in skip list. These may sound like lame questions but
> I'm really curious now that I see a marked difference between two
> messages in lookup times.
Perhaps the older Net::DNS on the slower one is a factor?
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
USMC Rules of Gunfighting #9: Accuracy is relative: most combat
shooting standards will be more dependent on "pucker factor" than
the inherent accuracy of the gun.
-----------------------------------------------------------------------
71 days since Obama's inauguration and still no unicorn!
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by Chris <cp...@embarqmail.com>.
On Wed, 2009-04-01 at 15:23 -0700, John Hardin wrote:
>
> So /etc/resolv.conf has 127.0.0.1 as the only resolver?
>
Semi-related to this thread, why when running two different spams
through "spamassassin -D -t do I get widely different lookup times:
[17232] dbg: async: timing: 0.042 . NS:spamhaus.org
[17232] dbg: async: timing: 0.043 .
DNSBL:dob.sibl.support-intelligence.net:spamhaus.org
[17232] dbg: async: timing: 0.043 . NS:barracudacentral.org
[17232] dbg: async: timing: 0.044 . DNSBL:multi.uribl.com.:spamhaus.org
[17232] dbg: async: timing: 0.044 .
DNSBL:dob.sibl.support-intelligence.net:barracudacentral.org
[17232] dbg: async: timing: 0.045 .
DNSBL:multi.uribl.com.:barracudacentral.org
[17232] dbg: async: timing: 0.046 . NS:rhyolite.com
[17232] dbg: async: timing: 0.049 . DNSBL:multi.uribl.com.:rhyolite.com
[17232] dbg: async: timing: 0.051 . NS:dnswl.org
[17232] dbg: async: timing: 0.053 .
DNSBL:dob.sibl.support-intelligence.net:dnswl.org
[17232] dbg: async: timing: 0.054 . DNSBL:multi.uribl.com.:dnswl.org
[17232] dbg: async: timing: 0.057 . DNSBL:multi.surbl.org.:rhyolite.com
[17232] dbg: async: timing: 0.078 . DNSBL:multi.surbl.org.:dnswl.org
[17232] dbg: async: timing: 0.084 .
DNSBL:multi.surbl.org.:barracudacentral.org
[17232] dbg: async: timing: 0.886 . A:ns6.gandi.net.
[17232] dbg: async: timing: 0.886 . A:zone-ns2.dnswl.org.
[17232] dbg: async: timing: 0.887 . A:ns.morenines.net.
[17232] dbg: async: timing: 0.888 . A:dnswl1.chaosreigns.com.
[17232] dbg: async: timing: 0.888 . A:ns2.sorbs.net.
[17232] dbg: async: timing: 0.889 . A:ns0.sorbs.net.
[17232] dbg: async: timing: 0.890 . A:zone-ns.dnswl.org.
[17232] dbg: async: timing: 0.891 . A:ns1.sorbs.net.
[17232] dbg: async: timing: 0.907 . A:ns4.nameresolve.com.
[17232] dbg: async: timing: 0.908 . A:ns1.nameresolve.com.
[17232] dbg: async: timing: 0.909 . A:ns2.nameresolve.com.
[17232] dbg: async: timing: 0.909 . A:ns3.nameresolve.com.
[17232] dbg: async: timing: 0.909 . A:ns1.isc-sns.net.
[17232] dbg: async: timing: 0.910 . A:ns.rhyolite.com.
[17232] dbg: async: timing: 0.910 . A:ns2.spamhaus.org.
[17232] dbg: async: timing: 0.912 . A:ns.dcc-servers.net.
[17232] dbg: async: timing: 0.913 . A:ns2.isc-sns.com.
[17232] dbg: async: timing: 0.913 . A:ns3.xs4all.nl.
[17232] dbg: async: timing: 0.914 . A:ns.dns-oarc.net.
[17232] dbg: async: timing: 0.914 . A:ns4.surfnet.nl.
[17232] dbg: async: timing: 0.915 . A:ns8.spamhaus.org.
[17232] dbg: async: timing: 0.915 . A:ns3.spamhaus.org.
[17232] dbg: async: timing: 0.916 . A:ns20.ja.net.
[17232] dbg: async: timing: 0.970 . DNSBL:multi.surbl.org.:spamhaus.org
[17232] dbg: async: timing: 0.977 .
DNSBL:dob.sibl.support-intelligence.net:rhyolite.com
[17232] dbg: async: timing: 21.769 . DNSBL:sbl.spamhaus.org.:1.2.103.38
[17232] dbg: async: timing: 21.770 .
DNSBL:sbl.spamhaus.org.:230.151.75.62
[17232] dbg: async: timing: 21.772 .
DNSBL:sbl.spamhaus.org.:29.14.169.209
[17232] dbg: async: timing: 21.775 .
DNSBL:sbl.spamhaus.org.:35.51.15.203
[17232] dbg: async: timing: 21.776 .
DNSBL:sbl.spamhaus.org.:125.246.106.87
[17232] dbg: async: timing: 21.776 .
DNSBL:sbl.spamhaus.org.:101.9.109.194
[17232] dbg: async: timing: 21.777 . DNSBL:sbl.spamhaus.org.:1.71.52.72
[17232] dbg: async: timing: 21.779 .
DNSBL:sbl.spamhaus.org.:196.117.94.64
[17232] dbg: async: timing: 21.780 .
DNSBL:sbl.spamhaus.org.:227.254.236.62
[17232] dbg: async: timing: 21.804 .
DNSBL:sbl.spamhaus.org.:226.92.198.88
[17232] dbg: async: timing: 21.805 .
DNSBL:sbl.spamhaus.org.:3.61.188.192
[17232] dbg: async: timing: 21.806 .
DNSBL:sbl.spamhaus.org.:66.28.183.69
[17232] dbg: async: timing: 21.806 .
DNSBL:sbl.spamhaus.org.:110.31.94.64
[17232] dbg: async: timing: 21.807 .
DNSBL:sbl.spamhaus.org.:40.152.71.64
[17232] dbg: async: timing: 21.808 .
DNSBL:sbl.spamhaus.org.:239.216.94.82
[17232] dbg: async: timing: 21.809 .
DNSBL:sbl.spamhaus.org.:40.177.70.217
[17232] dbg: async: timing: 21.810 .
DNSBL:sbl.spamhaus.org.:65.58.20.149
[17232] dbg: async: timing: 21.812 .
DNSBL:sbl.spamhaus.org.:5.224.241.207
[17232] dbg: async: timing: 21.813 .
DNSBL:sbl.spamhaus.org.:101.124.169.195
[17232] dbg: async: timing: 21.814 .
DNSBL:sbl.spamhaus.org.:6.174.82.194
[17232] dbg: async: timing: 21.816 .
DNSBL:sbl.spamhaus.org.:82.83.251.63
[17232] dbg: async: timing: 21.817 .
DNSBL:sbl.spamhaus.org.:200.94.150.192
[17232] dbg: async: timing: 21.819 .
DNSBL:sbl.spamhaus.org.:132.161.150.66
and the other one shows:
[17352] dbg: async: timing: 0.048 .
DNSBL:dob.sibl.support-intelligence.net:150.54.13.69
[17352] dbg: async: timing: 0.050 . A:ns2.lax.propagation.net.
[17352] dbg: async: timing: 0.051 . A:ns1.lax.propagation.net.
[17352] dbg: async: timing: 0.052 . A:vns1.propagation.net.
[17352] dbg: async: timing: 0.053 . A:ns3.propagation.net.
[17352] dbg: async: timing: 0.053 . DNSBL:multi.uribl.com.:150.54.13.69
[17352] dbg: async: timing: 0.053 . DNSBL:multi.surbl.org.:150.54.13.69
[17352] dbg: async: timing: 0.053 . A:ns.propagation.net.
[17352] dbg: async: timing: 0.057 . NS:circularsolutions.net
[17352] dbg: async: timing: 0.058 .
DNSBL:dob.sibl.support-intelligence.net:circularsolutions.net
[17352] dbg: async: timing: 0.059 .
DNSBL:multi.uribl.com.:circularsolutions.net
[17352] dbg: async: timing: 0.059 . A:ns4.propagation.net.
[17352] dbg: async: timing: 0.062 . A:ns2.propagation.net.
[17352] dbg: async: timing: 0.063 . A:vns0.propagation.net.
[17352] dbg: async: timing: 0.066 . A:dns2.stabletransit.com.
[17352] dbg: async: timing: 0.069 . A:dns1.stabletransit.com.
[17352] dbg: async: timing: 0.070 . NS:peakperformancesalestraining.com
[17352] dbg: async: timing: 0.071 . A:ns2.isc-sns.com.
[17352] dbg: async: timing: 0.073 . A:ns3.nameresolve.com.
[17352] dbg: async: timing: 0.076 . A:ns.dcc-servers.net.
[17352] dbg: async: timing: 0.080 . A:ns1.nameresolve.com.
[17352] dbg: async: timing: 0.080 . A:ns4.nameresolve.com.
[17352] dbg: async: timing: 0.080 . A:ns.rhyolite.com.
[17352] dbg: async: timing: 0.080 . A:ns2.nameresolve.com.
[17352] dbg: async: timing: 0.081 . A:ns2.ipower.com.
[17352] dbg: async: timing: 0.081 .
DNSBL:multi.uribl.com.:peakperformancesalestraining.com
[17352] dbg: async: timing: 0.082 . A:ns1.isc-sns.net.
[17352] dbg: async: timing: 0.084 . NS:rhyolite.com
[17352] dbg: async: timing: 0.085 . A:ns1.ipower.com.
[17352] dbg: async: timing: 0.085 . DNSBL:multi.surbl.org.:rhyolite.com
[17352] dbg: async: timing: 0.086 . NS:peakperformancellc.com
[17352] dbg: async: timing: 0.087 . NS:barracudacentral.org
[17352] dbg: async: timing: 0.090 .
DNSBL:multi.uribl.com.:peakperformancellc.com
[17352] dbg: async: timing: 0.091 . NS:mailmailer.com
[17352] dbg: async: timing: 0.094 .
DNSBL:dob.sibl.support-intelligence.net:rhyolite.com
[17352] dbg: async: timing: 0.096 .
DNSBL:dob.sibl.support-intelligence.net:barracudacentral.org
[17352] dbg: async: timing: 0.100 .
DNSBL:multi.uribl.com.:mailmailer.com
[17352] dbg: async: timing: 0.100 .
DNSBL:dob.sibl.support-intelligence.net:peakperformancesalestraining.com
[17352] dbg: async: timing: 0.104 .
DNSBL:dob.sibl.support-intelligence.net:peakperformancellc.com
[17352] dbg: async: timing: 0.105 .
DNSBL:multi.surbl.org.:barracudacentral.org
[17352] dbg: async: timing: 0.120 .
DNSBL:dob.sibl.support-intelligence.net:mailmailer.com
[17352] dbg: async: timing: 0.192 . DNSBL:sbl.spamhaus.org.:150.54.13.69
[17352] dbg: async: timing: 0.210 .
DNSBL:multi.surbl.org.:circularsolutions.net
[17352] dbg: async: timing: 0.223 .
DNSBL:multi.surbl.org.:peakperformancesalestraining.com
[17352] dbg: async: timing: 0.245 .
DNSBL:multi.surbl.org.:peakperformancellc.com
[17352] dbg: async: timing: 0.260 .
DNSBL:multi.surbl.org.:mailmailer.com
[17352] dbg: async: timing: 1.120 . DNSBL:sbl.spamhaus.org.:1.2.103.38
[17352] dbg: async: timing: 1.127 . DNSBL:sbl.spamhaus.org.:211.72.20.69
[17352] dbg: async: timing: 1.131 .
DNSBL:sbl.spamhaus.org.:196.117.94.64
[17352] dbg: async: timing: 1.134 .
DNSBL:sbl.spamhaus.org.:10.160.221.216
[17352] dbg: async: timing: 1.141 . DNSBL:sbl.spamhaus.org.:110.31.94.64
[17352] dbg: async: timing: 1.144 .
DNSBL:sbl.spamhaus.org.:204.128.249.63
[17352] dbg: async: timing: 1.146 .
DNSBL:sbl.spamhaus.org.:144.254.254.65
[17352] dbg: async: timing: 1.147 . DNSBL:sbl.spamhaus.org.:1.193.34.66
[17352] dbg: async: timing: 1.154 .
DNSBL:sbl.spamhaus.org.:109.142.96.66
[17352] dbg: async: timing: 1.155 . DNSBL:sbl.spamhaus.org.:1.104.97.216
[17352] dbg: async: timing: 1.158 .
DNSBL:sbl.spamhaus.org.:106.162.221.216
[17352] dbg: async: timing: 1.159 .
DNSBL:sbl.spamhaus.org.:29.14.169.209
[17352] dbg: async: timing: 1.160 . DNSBL:sbl.spamhaus.org.:2.193.34.66
[17352] dbg: async: timing: 1.162 . DNSBL:sbl.spamhaus.org.:1.71.52.72
[17352] dbg: async: timing: 1.164 . DNSBL:sbl.spamhaus.org.:3.61.188.192
[17352] dbg: async: timing: 1.165 . DNSBL:sbl.spamhaus.org.:82.83.251.63
[17352] dbg: async: timing: 1.167 . DNSBL:sbl.spamhaus.org.:1.105.97.216
[17352] dbg: async: timing: 1.177 .
DNSBL:sbl.spamhaus.org.:102.166.61.65
[17352] dbg: async: timing: 1.180 .
DNSBL:sbl.spamhaus.org.:132.161.150.66
[17352] dbg: async: timing: 1.190 .
DNSBL:sbl.spamhaus.org.:203.128.249.63
[17352] dbg: async: timing: 1.451 . DNSBL:multi.uribl.com.:rhyolite.com
[17352] dbg: async: timing: 1.480 .
DNSBL:multi.uribl.com.:barracudacentral.org
Using a local caching nameserver with 127.0.0.1 as my nameserver, BIND
9.5.0-P2, Net::DNS 0.65. I notice that the slowest one shows:
[14035] dbg: dns: is Net::DNS::Resolver available? yes
[14035] dbg: dns: Net::DNS version: 0.63
[14035] dbg: dns: name server: 127.0.0.1, LocalAddr: 0.0.0.0
[14035] dbg: dns: resolver socket rx buffer size is 112640 bytes
[14035] dbg: dns: dns_available set to yes in config file, skipping test
[14035] dbg: uridnsbl: domain spamcop.net in skip list
[14035] dbg: uridnsbl: domain sf.net in skip list
[14035] dbg: uridnsbl: domain spamcop.net in skip list
[14035] dbg: uridnsbl: domain spamcop.net in skip list
[14035] dbg: uridnsbl: domain sf.net in skip list
[14035] dbg: uridnsbl: domains to query: barracudacentral.org dnswl.org
rhyolite.com spamhaus.org
and the faster one shows:
[17352] dbg: dns: is Net::DNS::Resolver available? yes
[17352] dbg: dns: Net::DNS version: 0.65
[17352] dbg: dns: name server: 127.0.0.1, LocalAddr: 0.0.0.0
[17352] dbg: dns: resolver socket rx buffer size is 112640 bytes
[17352] dbg: dns: dns_available set to yes in config file, skipping test
[17352] dbg: uridnsbl: domain sf.net in skip list
[17352] dbg: uridnsbl: domains to query: barracudacentral.org
mailmailer.com peakperformancellc.com rhyolite.com
peakperformancesalestraining.com circularsolutions.net 69.13.54.150
For the longest I've been seeing average scan times like this:
Email: 35 Autolearn: 0 AvgScore: 13.34 AvgScanTime: 14.78 sec
Spam: 14 Autolearn: 0 AvgScore: 38.43 AvgScanTime: 15.16 sec
Ham: 21 Autolearn: 0 AvgScore: -3.38 AvgScanTime: 14.53 sec
Why the difference in skip list. These may sound like lame questions but
I'm really curious now that I see a marked difference between two
messages in lookup times.
--
KeyID 0xE372A7DA98E6705C
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Wed, 1 Apr 2009, alexus wrote:
> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
>
>> How fast are non-SA DNS queries on that box? If they take ten seconds
>> to return an answer, SA is not the culprit.
>
> without dns they are 0.1 - 1.5s, with DNS they are ~7s
...what precisely do you mean by "with DNS" and "without DNS"?
>> Review your /etc/resolv.conf to see if the first resolver listed is
>> responding quickly. You may want to rearrange them.
>
> I use local caching, so it's as fast as it gets
So /etc/resolv.conf has 127.0.0.1 as the only resolver?
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
For those who are being swayed by Microsoft's whining about the
GPL, consider how aggressively viral their Shared Source license is:
If you've *ever* seen *any* MS code covered by the Shared Source
license, you're infected for life. MS can sue you for Intellectual
Property misappropriation whenever they like, so you'd better not
come up with any Innovative Ideas that they want to Embrace...
-----------------------------------------------------------------------
Today: April Fools' day
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Wed, 8 Apr 2009, alexus wrote:
> On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
> <uh...@fantomas.sk> wrote:
>>> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
>>>> How fast are non-SA DNS queries on that box? If they take ten seconds to
>>>> return an answer, SA is not the culprit.
>>
>> On 01.04.09 17:53, alexus wrote:
>>> without dns they are 0.1 - 1.5s, with DNS they are ~7s
>>
>> by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
>> FYI.
>
> what I meant is SA without this:
>
> v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
Are your scan times still bouncing around? Or did you turn DNS off again?
(The story so far: offlist we verified a local DNS cache was being used
and SA was brought up-to-date - dsbl was still being queried, sa-update
fixed that. Now the scan times are inconsistent - some short
~1sec, some long ~6sec.)
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
You can't reason a person out of a position if he didn't use
reason to get there in the first place. -- Kristopher, at Marko's
-----------------------------------------------------------------------
5 days until Thomas Jefferson's 266th Birthday
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Wed, Apr 8, 2009 at 12:04 PM, Matus UHLAR - fantomas
<uh...@fantomas.sk> wrote:
>> On Wed, Apr 8, 2009 at 11:21 AM, Matus UHLAR - fantomas
>> <uh...@fantomas.sk> wrote:
>> >> On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
>> >> <uh...@fantomas.sk> wrote:
>> >> >> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
>> >> >> > How fast are non-SA DNS queries on that box? If they take ten seconds to
>> >> >> > return an answer, SA is not the culprit.
>> >> >
>> >> > On 01.04.09 17:53, alexus wrote:
>> >> >> without dns they are 0.1 - 1.5s, with DNS they are ~7s
>> >> >
>> >> > by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
>> >> > FYI.
>> >
>> > On 08.04.09 10:21, alexus wrote:
>> >> what I meant is SA without this:
>> >>
>> >> v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
>> >
>> > what HE (Josh Hardin) meant, is:
>> >
>> > dig www.microsoft.com.
>> > dig 66.36.168.195.zen.spamhaus.org
>> > dig mx surbl.org
>> >
>> > and look at the "Query time" result.
>
> On 08.04.09 11:40, alexus wrote:
>> root@mx1 ~ 503$ time dig www.microsoft.com.
>> ;; Query time: 0 msec
>
>> root@mx1 ~ 504$ time dig 66.36.168.195.zen.spamhaus.org
>> ;; Query time: 288 msec
>
>> root@mx1 ~ 505$ time dig mx surbl.org
>> ;; Query time: 80 msec
>
> seems good. But I think that your problem has been solved or am I wrong?
> At least you have learned what means "dns without spamassassin" :-)--
yeah, my spam assassin seems to be acting up all right.... go figure ;-)
> Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
> Warning: I wish NOT to receive e-mail advertising to this address.
> Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
> Fighting for peace is like fucking for virginity...
>
--
http://alexus.org/
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
> On Wed, Apr 8, 2009 at 11:21 AM, Matus UHLAR - fantomas
> <uh...@fantomas.sk> wrote:
> >> On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
> >> <uh...@fantomas.sk> wrote:
> >> >> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
> >> >> > How fast are non-SA DNS queries on that box? If they take ten seconds to
> >> >> > return an answer, SA is not the culprit.
> >> >
> >> > On 01.04.09 17:53, alexus wrote:
> >> >> without dns they are 0.1 - 1.5s, with DNS they are ~7s
> >> >
> >> > by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
> >> > FYI.
> >
> > On 08.04.09 10:21, alexus wrote:
> >> what I meant is SA without this:
> >>
> >> v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
> >
> > what HE (Josh Hardin) meant, is:
> >
> > dig www.microsoft.com.
> > dig 66.36.168.195.zen.spamhaus.org
> > dig mx surbl.org
> >
> > and look at the "Query time" result.
On 08.04.09 11:40, alexus wrote:
> root@mx1 ~ 503$ time dig www.microsoft.com.
> ;; Query time: 0 msec
> root@mx1 ~ 504$ time dig 66.36.168.195.zen.spamhaus.org
> ;; Query time: 288 msec
> root@mx1 ~ 505$ time dig mx surbl.org
> ;; Query time: 80 msec
seems good. But I think that your problem has been solved or am I wrong?
At least you have learned what means "dns without spamassassin" :-)--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Fighting for peace is like fucking for virginity...
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Wed, Apr 8, 2009 at 11:21 AM, Matus UHLAR - fantomas
<uh...@fantomas.sk> wrote:
>> On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
>> <uh...@fantomas.sk> wrote:
>> >> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
>> >> > How fast are non-SA DNS queries on that box? If they take ten seconds to
>> >> > return an answer, SA is not the culprit.
>> >
>> > On 01.04.09 17:53, alexus wrote:
>> >> without dns they are 0.1 - 1.5s, with DNS they are ~7s
>> >
>> > by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
>> > FYI.
>
> On 08.04.09 10:21, alexus wrote:
>> what I meant is SA without this:
>>
>> v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
>
> what HE (Josh Hardin) meant, is:
>
> dig www.microsoft.com.
> dig 66.36.168.195.zen.spamhaus.org
> dig mx surbl.org
>
> and look at the "Query time" result.
root@mx1 ~ 503$ time dig www.microsoft.com.
; <<>> DiG 9.4.2-P2 <<>> www.microsoft.com.
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 61055
;; flags: qr rd ra; QUERY: 1, ANSWER: 5, AUTHORITY: 9, ADDITIONAL: 4
;; QUESTION SECTION:
;www.microsoft.com. IN A
;; ANSWER SECTION:
www.microsoft.com. 3586 IN CNAME toggle.www.ms.akadns.net.
toggle.www.ms.akadns.net. 287 IN CNAME g.www.ms.akadns.net.
g.www.ms.akadns.net. 287 IN CNAME lb1.www.ms.akadns.net.
lb1.www.ms.akadns.net. 287 IN A 207.46.19.254
lb1.www.ms.akadns.net. 287 IN A 207.46.19.190
;; AUTHORITY SECTION:
akadns.net. 172786 IN NS use3.akadns.net.
akadns.net. 172786 IN NS zc.akadns.org.
akadns.net. 172786 IN NS use4.akadns.net.
akadns.net. 172786 IN NS usw2.akadns.net.
akadns.net. 172786 IN NS za.akadns.org.
akadns.net. 172786 IN NS asia9.akadns.net.
akadns.net. 172786 IN NS zd.akadns.org.
akadns.net. 172786 IN NS zb.akadns.org.
akadns.net. 172786 IN NS eur1.akadns.net.
;; ADDITIONAL SECTION:
za.akadns.org. 21587 IN A 213.254.204.197
zb.akadns.org. 21587 IN A 12.183.125.5
zc.akadns.org. 21587 IN A 124.40.52.133
zd.akadns.org. 21587 IN A 204.2.178.133
;; Query time: 0 msec
;; SERVER: 64.237.55.72#53(64.237.55.72)
;; WHEN: Wed Apr 8 15:38:53 2009
;; MSG SIZE rcvd: 377
real 0m0.006s
user 0m0.000s
sys 0m0.006s
root@mx1 ~ 504$ time dig 66.36.168.195.zen.spamhaus.org
; <<>> DiG 9.4.2-P2 <<>> 66.36.168.195.zen.spamhaus.org
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 34009
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;66.36.168.195.zen.spamhaus.org. IN A
;; AUTHORITY SECTION:
zen.spamhaus.org. 150 IN SOA need.to.know.only.
hostmaster.spamhaus.org. 2009040862 3600 600 432000 150
;; Query time: 288 msec
;; SERVER: 64.237.55.72#53(64.237.55.72)
;; WHEN: Wed Apr 8 15:38:58 2009
;; MSG SIZE rcvd: 112
real 0m0.294s
user 0m0.000s
sys 0m0.006s
root@mx1 ~ 505$ time dig mx surbl.org
; <<>> DiG 9.4.2-P2 <<>> mx surbl.org
;; global options: printcmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 48545
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 4, ADDITIONAL: 1
;; QUESTION SECTION:
;surbl.org. IN MX
;; ANSWER SECTION:
surbl.org. 3600 IN MX 10 mx1.prolexic.com.
surbl.org. 3600 IN MX 20 mx2.prolexic.com.
surbl.org. 3600 IN MX 30 mx3.prolexic.com.
;; AUTHORITY SECTION:
surbl.org. 45747 IN NS ns201.surbl.org.
surbl.org. 45747 IN NS ns200.surbl.org.
surbl.org. 45747 IN NS ns101.surbl.org.
surbl.org. 45747 IN NS ns100.surbl.org.
;; ADDITIONAL SECTION:
ns201.surbl.org. 45747 IN A 192.42.119.21
;; Query time: 80 msec
;; SERVER: 64.237.55.72#53(64.237.55.72)
;; WHEN: Wed Apr 8 15:39:05 2009
;; MSG SIZE rcvd: 195
real 0m0.086s
user 0m0.000s
sys 0m0.006s
root@mx1 ~ 506$
> --
> Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
> Warning: I wish NOT to receive e-mail advertising to this address.
> Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
> "One World. One Web. One Program." - Microsoft promotional advertisement
> "Ein Volk, ein Reich, ein Fuhrer!" - Adolf Hitler
>
--
http://alexus.org/
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
> On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
> <uh...@fantomas.sk> wrote:
> >> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
> >> > How fast are non-SA DNS queries on that box? If they take ten seconds to
> >> > return an answer, SA is not the culprit.
> >
> > On 01.04.09 17:53, alexus wrote:
> >> without dns they are 0.1 - 1.5s, with DNS they are ~7s
> >
> > by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
> > FYI.
On 08.04.09 10:21, alexus wrote:
> what I meant is SA without this:
>
> v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
what HE (Josh Hardin) meant, is:
dig www.microsoft.com.
dig 66.36.168.195.zen.spamhaus.org
dig mx surbl.org
and look at the "Query time" result.
--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
"One World. One Web. One Program." - Microsoft promotional advertisement
"Ein Volk, ein Reich, ein Fuhrer!" - Adolf Hitler
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Sat, Apr 4, 2009 at 5:48 AM, Matus UHLAR - fantomas
<uh...@fantomas.sk> wrote:
>> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
>> > How fast are non-SA DNS queries on that box? If they take ten seconds to
>> > return an answer, SA is not the culprit.
>
> On 01.04.09 17:53, alexus wrote:
>> without dns they are 0.1 - 1.5s, with DNS they are ~7s
>
> by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
> FYI.
what I meant is SA without this:
v320.pre:loadplugin Mail::SpamAssassin::Plugin::DNSEval
> --
> Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
> Warning: I wish NOT to receive e-mail advertising to this address.
> Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
> There's a long-standing bug relating to the x86 architecture that
> allows you to install Windows. -- Matthew D. Fuller
>
--
http://alexus.org/
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by Matus UHLAR - fantomas <uh...@fantomas.sk>.
> On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
> > How fast are non-SA DNS queries on that box? If they take ten seconds to
> > return an answer, SA is not the culprit.
On 01.04.09 17:53, alexus wrote:
> without dns they are 0.1 - 1.5s, with DNS they are ~7s
by "non-SA DNS" he did not mean SA without DNS, but DNS without SA... just
FYI.
--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
There's a long-standing bug relating to the x86 architecture that
allows you to install Windows. -- Matthew D. Fuller
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Wed, Apr 1, 2009 at 5:52 PM, John Hardin <jh...@impsec.org> wrote:
> On Wed, 1 Apr 2009, alexus wrote:
>
>> okay, we like really far away from original thread, i said that
>> SpamAssassin runs really slow for me and on top of that I even found which
>> plugin causing that, which is this:
>>
>> loadplugin Mail::SpamAssassin::Plugin::DNSEval
>>
>> I had to disable it, if someone can suggest something in order to make it
>> work faster i'm all ears
>
> How fast are non-SA DNS queries on that box? If they take ten seconds to
> return an answer, SA is not the culprit.
without dns they are 0.1 - 1.5s, with DNS they are ~7s
> Review your /etc/resolv.conf to see if the first resolver listed is
> responding quickly. You may want to rearrange them.
I use local caching, so it's as fast as it gets
> It's good practice to use a local caching DNS server. Are you resolving via
> a caching DNS server on your local network, or is the SA box resolving
> directly via your ISP DNS servers or other public DNS servers? If the
> latter, consider installing a caching DNS server on the SA box and use that
> for name resolution.
>
> --
> John Hardin KA7OHZ http://www.impsec.org/~jhardin/
> jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
> key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
> -----------------------------------------------------------------------
> ...in the 2nd amendment the right to arms clause means you have
> the right to choose how many arms you want, and the militia clause
> means that Congress can punish you if the answer is "none."
> -- David Hardy, 2nd Amendment scholar
> -----------------------------------------------------------------------
> Today: April Fools' day
>
--
http://alexus.org/
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Wed, 1 Apr 2009, alexus wrote:
> okay, we like really far away from original thread, i said that
> SpamAssassin runs really slow for me and on top of that I even found
> which plugin causing that, which is this:
>
> loadplugin Mail::SpamAssassin::Plugin::DNSEval
>
> I had to disable it, if someone can suggest something in order to make
> it work faster i'm all ears
How fast are non-SA DNS queries on that box? If they take ten seconds to
return an answer, SA is not the culprit.
Review your /etc/resolv.conf to see if the first resolver listed is
responding quickly. You may want to rearrange them.
It's good practice to use a local caching DNS server. Are you resolving
via a caching DNS server on your local network, or is the SA box resolving
directly via your ISP DNS servers or other public DNS servers? If the
latter, consider installing a caching DNS server on the SA box and use
that for name resolution.
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
...in the 2nd amendment the right to arms clause means you have
the right to choose how many arms you want, and the militia clause
means that Congress can punish you if the answer is "none."
-- David Hardy, 2nd Amendment scholar
-----------------------------------------------------------------------
Today: April Fools' day
Re: [OT] Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Wed, Apr 1, 2009 at 4:49 PM, David Morton <mo...@dgrmm.net> wrote:
> Karsten Bräckelmann wrote:
>> On Fri, 2009-03-27 at 23:59 +0200, Jari Fredriksson wrote:
>>> I just hope that as good as SA is will be written in some programming
>>> language, and not scripting language. Even Java would be better.
>>
>> Dude, you just lost a credit point... ;)
>>
>> Everyone, if you feel the urge to contribute to this thread any further,
>> please first *do* check the list archives -- this pointless thread comes
>> up like once a year. If you believe you can come up with a convincing
>> argument that has *not* been mentioned and turned down before, and which
>> takes "active contributors code Perl" into account... please try.
>
> Agreed. Anytime anyone starts talking about speed and languages, I roll
> my eyes. Seriously, unless you are a developer and have actually run
> code through a profiler to know what areas are running "slow", you are
> not qualified to make such statements.
>
> If you *have* run the code through a profiler and can prove that a
> majority of time is spent inside a language construct and not on I/O or
> a bad algorithm, then you are qualified... to submit a bug report to the
> language developers so they can fix it. Anything else is just bogus.
>
>
okay, we like really far away from original thread, i said that
SpamAssassin runs really slow for me and on top of that I even found
which plugin causing that, which is this:
loadplugin Mail::SpamAssassin::Plugin::DNSEval
I had to disable it, if someone can suggest something in order to make
it work faster i'm all ears
--
http://alexus.org/
[OT] Re: SpamAssassin is EXTREMLY slow
Posted by David Morton <mo...@dgrmm.net>.
Karsten Bräckelmann wrote:
> On Fri, 2009-03-27 at 23:59 +0200, Jari Fredriksson wrote:
>> I just hope that as good as SA is will be written in some programming
>> language, and not scripting language. Even Java would be better.
>
> Dude, you just lost a credit point... ;)
>
> Everyone, if you feel the urge to contribute to this thread any further,
> please first *do* check the list archives -- this pointless thread comes
> up like once a year. If you believe you can come up with a convincing
> argument that has *not* been mentioned and turned down before, and which
> takes "active contributors code Perl" into account... please try.
Agreed. Anytime anyone starts talking about speed and languages, I roll
my eyes. Seriously, unless you are a developer and have actually run
code through a profiler to know what areas are running "slow", you are
not qualified to make such statements.
If you *have* run the code through a profiler and can prove that a
majority of time is spent inside a language construct and not on I/O or
a bad algorithm, then you are qualified... to submit a bug report to the
language developers so they can fix it. Anything else is just bogus.
Re: SpamAssassin is EXTREMLY slow
Posted by Karsten Bräckelmann <gu...@rudersport.de>.
On Fri, 2009-03-27 at 23:59 +0200, Jari Fredriksson wrote:
> I just hope that as good as SA is will be written in some programming
> language, and not scripting language. Even Java would be better.
Dude, you just lost a credit point... ;)
Everyone, if you feel the urge to contribute to this thread any further,
please first *do* check the list archives -- this pointless thread comes
up like once a year. If you believe you can come up with a convincing
argument that has *not* been mentioned and turned down before, and which
takes "active contributors code Perl" into account... please try.
I don't see how this is related to the OP and his logs anyway.
--
char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4";
main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1:
(c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}
Re: SpamAssassin is EXTREMLY slow
Posted by Jari Fredriksson <ja...@iki.fi>.
> On Sat, 28 Mar 2009, Jari Fredriksson wrote:
>
>>> On Fri, Mar 27, 2009 at 5:59 PM, Jari Fredriksson
>>> <ja...@iki.fi> wrote:
>>>>
>>>> Yes, it is terribly slow.
>>>>
>>>> I just hope that as good as SA is will be written in
>>>> some programming language, and not scripting language.
>>>> Even Java would be better.
>>>
>>> C?:) I wouldn't count on that anytime soon...
>>
>> C is too vulnerable to programming errors, but spamd
>> written in Java would do fine. Java is great for server
>> type processes, its slugginess is mostly the process
>> load time. As a persistent process it would do fine.
>
> Is the Java regex library faster than the regex library
> that Perl uses?
Propably not. Perl uses native code libraries for stuff like that, and there should not be much diffrence.
But the overall "business logic" in SpamAssassin could do better when compiled (by Java JIT).
Re: SpamAssassin is EXTREMLY slow
Posted by John Hardin <jh...@impsec.org>.
On Sat, 28 Mar 2009, Jari Fredriksson wrote:
>> On Fri, Mar 27, 2009 at 5:59 PM, Jari Fredriksson
>> <ja...@iki.fi> wrote:
>>>
>>> Yes, it is terribly slow.
>>>
>>> I just hope that as good as SA is will be written in
>>> some programming language, and not scripting language.
>>> Even Java would be better.
>>
>> C?:) I wouldn't count on that anytime soon...
>
> C is too vulnerable to programming errors, but spamd written in Java
> would do fine. Java is great for server type processes, its slugginess
> is mostly the process load time. As a persistent process it would do
> fine.
Is the Java regex library faster than the regex library that Perl uses?
--
John Hardin KA7OHZ http://www.impsec.org/~jhardin/
jhardin@impsec.org FALaholic #11174 pgpk -a jhardin@impsec.org
key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
Usually Microsoft doesn't develop products, we buy products.
-- Arno Edelmann, Microsoft product manager
-----------------------------------------------------------------------
5 days until April Fools' day
Re: SpamAssassin is EXTREMLY slow
Posted by Jari Fredriksson <ja...@iki.fi>.
> On Fri, Mar 27, 2009 at 5:59 PM, Jari Fredriksson
> <ja...@iki.fi> wrote:
>>
>> Yes, it is terribly slow.
>>
>> I just hope that as good as SA is will be written in
>> some programming language, and not scripting language.
>> Even Java would be better.
>>
>
> C?:) I wouldn't count on that anytime soon...
C is too vulnerable to programming errors, but spamd written in Java would do fine. Java is great for server type processes, its slugginess is mostly the process load time. As a persistent process it would do fine.
Re: SpamAssassin is EXTREMLY slow
Posted by alexus <al...@gmail.com>.
On Fri, Mar 27, 2009 at 5:59 PM, Jari Fredriksson <ja...@iki.fi> wrote:
>
> Yes, it is terribly slow.
>
> I just hope that as good as SA is will be written in some programming language, and not scripting language. Even Java would be better.
>
C?:) I wouldn't count on that anytime soon...
--
http://alexus.org/
Re: SpamAssassin is EXTREMLY slow
Posted by Jari Fredriksson <ja...@iki.fi>.
Yes, it is terribly slow.
I just hope that as good as SA is will be written in some programming language, and not scripting language. Even Java would be better.
Re: SpamAssassin is EXTREMLY slow
Posted by Mark Martinec <Ma...@ijs.si>.
alexus,
> SpamAssassin is EXTREMLY slow
> mx1# /usr/local/bin/spamd --allow-tell --vpopmail --username=spamd
> [96985] dbg: message: main message type: text/plain
> [96985] dbg: message: ---- MIME PARSER START ----
> [96985] dbg: message: parsing normal part
[...]
Find out what is taking most of the time,
provide some timestamps on the log.
Here is one way, pipe the log output from spamassassin -D
or from a non-daemonized spamd through a timestamping program
like the following function in my .bashrc:
timestamp ()
{
perl -MPOSIX -MTime::HiRes -n -e '
BEGIN {$|=1; $dp=0; $t0=Time::HiRes::time};
$t=Time::HiRes::time; $dt=$t-$t0; printf("%s%06.3f %4.3f %4.3f %s",
POSIX::strftime("%H:%M:",localtime($t)), $t-int($t/60)*60,
$dt, $dt-$dp, $_); $dp=$dt' $*
}
E.g. (assuming sh or bash):
spamd -D 2>&1 | timestamp
or:
spamassassin -D <0.msg 2>&1 | timestamp
Another way is to use SpamAssassin 3.3 (from CVS), which can provide
timing breakdown of actions, e.g.:
[1073] dbg: timing: total 19157 ms - init: 7290 (38.1%), parse: 6 (0.0%),
extract_message_metadata: 286 (1.5%), get_uri_detail_list: 9 (0.0%),
tests_pri_-1000: 44 (0.2%), compile_gen: 8144 (42.5%),
compile_eval: 37 (0.2%), tests_pri_-950: 9 (0.0%), tests_pri_-900: 6 (0.0%),
tests_pri_-400: 64 (0.3%), check_bayes: 57 (0.3%), tests_pri_0: 10888 (56.8%),
dkim_load_modules: 33 (0.2%), check_dkim_signature: 1.31 (0.0%),
check_dkim_adsp: 3 (0.0%), check_spf: 46 (0.2%), poll_dns_idle: 0.06 (0.0%),
check_razor2: 552 (2.9%), check_dcc: 157 (0.8%), check_pyzor: 0.14 (0.0%),
tests_pri_500: 232 (1.2%), tests_pri_899: 155 (0.8%),
check_crm114: 148 (0.8%), tests_pri_1000: 110 (0.6%), total_awl: 104 (0.5%),
check_awl: 4 (0.0%), update_awl: 74 (0.4%)
(also visible in the amavisd log at log level 2 or above, if using it with SA 3.3)
> [97034] dbg: async: timing: 0.515 . dns:A:106.67.10.69.iadb.isipp.com.
> [97034] dbg: async: timing: 2.564 . dns:TXT:106.67.10.69.sa-trusted.bondedsender.org.
> [97034] dbg: async: timing: 5.125 . dns:A:106.67.10.69.list.dnswl.org.
> [97034] dbg: async: timing: 6.405 . dns:A:106.67.10.69.sa-accredit.habeas.com.
> [97034] dbg: async: timing: 7.431 . dns:TXT:106.67.10.69.list.dsbl.org.
> [97034] dbg: async: timing: 9.223 . dns:A:106.67.10.69.dnsbl.sorbs.net.
> [97034] dbg: async: timing: 10.504 . dns:A:106.67.10.69.zen.spamhaus.org.
> [97034] dbg: async: timing: 11.784 . dns:TXT:106.67.10.69.bl.spamcop.net.
> [97034] dbg: async: timing: 13.065 . dns:A:106.67.10.69.combined.njabl.org.
> [97034] dbg: async: timing: 14.345 . dns:A:106.67.10.69.plus.bondedsender.org.
Your DNS lookups are very slow. Use a caching DNS server on your LAN or host,
and consider reducing your rbl_timeout.
Mark
Re: SpamAssassin is EXTREMLY slow
Posted by Jari Fredriksson <ja...@iki.fi>.
Amavisd-new with clamav-daemon and SaneSecurity is blazing fast.
2/3 of my spam seems to get caught by SaneSecurity, only the surviving 1/3 of them gets nailed by SpamAssassin (called via spamc in maildroprc, not amavisd).
SaneSecurity is good. No false positives so far.