You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Thomas Kinghorn <th...@mtnns.net> on 2004/08/03 12:38:14 UTC

more are more junk getting through

Hi List

I have had a dramatic increase in junk mail,

I am using SA 2.63 with SURBL.
MTA is exim 4.34 using sa-exim-4

I have attached a sample.

Subjects and originating IP's are always different
But the formatting of the body is similar.

Any ideas would be appreciated.

 <<important increased muscle mass without exercise.msg>> 

Regards, 

Tom Kinghorn


Re: Re[2]: more are more junk getting through

Posted by Sandy S <sa...@boreal.org>.
----- Original Message ----- 
From: "Robert Menschel" <Ro...@menschel.net>
To: "Sandy S" <sa...@boreal.org>
Cc: "Thomas Kinghorn" <th...@mtnns.net>;
<sp...@incubator.apache.org>
Sent: Tuesday, August 03, 2004 2:42 PM
Subject: Re[2]: more are more junk getting through


> Hello Sandy,
>
> Tuesday, August 3, 2004, 6:43:13 AM, you wrote:
>
> SS> Tom  -
> SS> I've seen these too, and have put in the following rules to try and
catch
> SS> them.  They've helped, but a few are still slipping through.  I think
if you
> SS> raise the scores some they'd catch a lot more, but I need to be a
little
> SS> more sure I won't get FPs before I do this!
>
> Sandy, results of my mass-check here:
>
> Section 3 -- Frequencies Log
> (First numeric frequencies, followed by percentage frequencies)
>
> OVERALL%   SPAM%     HAM%     S/O          SCORE  NAME
>   58315    33581    24734    0.576   0.00   0.00  (all messages)
>     668      462      206    0.623   1.00   0.60  ODD_CHAR_COMMA_BA
>     287      249       38    0.828   0.89   0.60  ODD_CHAR_CARET_BA
>     557      261      296    0.394   0.78   0.60  ODD_CHAR_DOT_BA
>      75       44       31    0.511   0.44   0.60  ODD_CHAR_TIC1_BA
>     887      197      690    0.174   0.33   0.60  ODD_CHAR_UNDERSCORE_BA
>    6363      240     6123    0.028   0.11   0.60  ODD_CHAR_TILDE_BA
>    5988      194     5794    0.024   0.00   0.60  ODD_CHAR_DASH_BA
>    1151      183      968    0.122   0.00   0.60  ODD_CHAR_TIC2_BA
>
> OVERALL%   SPAM%     HAM%     S/O    RANK   SCORE  NAME
>   58315    33581    24734    0.576   0.00    0.00  (all messages)
> 100.000  57.5855  42.4145    0.576   0.00    0.00  (all messages as %)
>   1.146   1.3758   0.8329    0.623   1.00    0.60  ODD_CHAR_COMMA_BA
>   0.492   0.7415   0.1536    0.828   0.89    0.60  ODD_CHAR_CARET_BA
>   0.955   0.7772   1.1967    0.394   0.78    0.60  ODD_CHAR_DOT_BA
>   0.129   0.1310   0.1253    0.511   0.44    0.60  ODD_CHAR_TIC1_BA
>   1.521   0.5866   2.7897    0.174   0.33    0.60  ODD_CHAR_UNDERSCORE_BA
>  10.911   0.7147  24.7554    0.028   0.11    0.60  ODD_CHAR_TILDE_BA
>  10.268   0.5777  23.4252    0.024   0.00    0.60  ODD_CHAR_DASH_BA
>   1.974   0.5450   3.9136    0.122   0.00    0.60  ODD_CHAR_TIC2_BA
>
> All these rules hit significant ham.  Indeed, UNDERSCORE_BA, DOT_BA,
> TILDE_BA, DASH_BA, and TIC2_BA hit more ham than spam in my corpus.
>
> Bob Menschel
>

Ouch!  Thanks for running the check.  Obviously I will need to keep these
scored very low if if I continue to use them.

Sandy



Re[2]: more are more junk getting through

Posted by Robert Menschel <Ro...@Menschel.net>.
Hello Sandy,

Tuesday, August 3, 2004, 6:43:13 AM, you wrote:

SS> Tom  -
SS> I've seen these too, and have put in the following rules to try and catch
SS> them.  They've helped, but a few are still slipping through.  I think if you
SS> raise the scores some they'd catch a lot more, but I need to be a little
SS> more sure I won't get FPs before I do this!

Sandy, results of my mass-check here:

Section 3 -- Frequencies Log
(First numeric frequencies, followed by percentage frequencies)

OVERALL%   SPAM%     HAM%     S/O          SCORE  NAME
  58315    33581    24734    0.576   0.00   0.00  (all messages)
    668      462      206    0.623   1.00   0.60  ODD_CHAR_COMMA_BA
    287      249       38    0.828   0.89   0.60  ODD_CHAR_CARET_BA
    557      261      296    0.394   0.78   0.60  ODD_CHAR_DOT_BA
     75       44       31    0.511   0.44   0.60  ODD_CHAR_TIC1_BA
    887      197      690    0.174   0.33   0.60  ODD_CHAR_UNDERSCORE_BA
   6363      240     6123    0.028   0.11   0.60  ODD_CHAR_TILDE_BA
   5988      194     5794    0.024   0.00   0.60  ODD_CHAR_DASH_BA
   1151      183      968    0.122   0.00   0.60  ODD_CHAR_TIC2_BA

OVERALL%   SPAM%     HAM%     S/O    RANK   SCORE  NAME
  58315    33581    24734    0.576   0.00    0.00  (all messages)
100.000  57.5855  42.4145    0.576   0.00    0.00  (all messages as %)
  1.146   1.3758   0.8329    0.623   1.00    0.60  ODD_CHAR_COMMA_BA
  0.492   0.7415   0.1536    0.828   0.89    0.60  ODD_CHAR_CARET_BA
  0.955   0.7772   1.1967    0.394   0.78    0.60  ODD_CHAR_DOT_BA
  0.129   0.1310   0.1253    0.511   0.44    0.60  ODD_CHAR_TIC1_BA
  1.521   0.5866   2.7897    0.174   0.33    0.60  ODD_CHAR_UNDERSCORE_BA
 10.911   0.7147  24.7554    0.028   0.11    0.60  ODD_CHAR_TILDE_BA
 10.268   0.5777  23.4252    0.024   0.00    0.60  ODD_CHAR_DASH_BA
  1.974   0.5450   3.9136    0.122   0.00    0.60  ODD_CHAR_TIC2_BA

All these rules hit significant ham.  Indeed, UNDERSCORE_BA, DOT_BA,
TILDE_BA, DASH_BA, and TIC2_BA hit more ham than spam in my corpus.

Bob Menschel


SS> body ODD_CHAR_DASH_BA /\-[,\~\'\`\_\.\^]/
SS> describe ODD_CHAR_DASH_BA Odd combo of special chars
SS> score ODD_CHAR_DASH_BA .6

SS> body ODD_CHAR_CARET_BA /\^[\-,\~\'\`\_\.\^]/
SS> describe ODD_CHAR_CARET_BA Odd combo of special chars
SS> score ODD_CHAR_CARET_BA .6

SS> body ODD_CHAR_DOT_BA /\.[\^\~\'\`\_]/
SS> describe ODD_CHAR_DOT_BA Odd combo of special chars
SS> score ODD_CHAR_DOT_BA .6

SS> body ODD_CHAR_UNDERSCORE_BA /\_[\.\^\-,\~\'\`]/
SS> describe ODD_CHAR_UNDERSCORE_BA Odd combo of special chars
SS> score ODD_CHAR_UNDERSCORE_BA .6

SS> body ODD_CHAR_TIC1_BA /\`[\_\.\^\-,\~\']/
SS> describe ODD_CHAR_TIC1_BA Odd combo of special chars
SS> score ODD_CHAR_TIC1_BA .6

SS> body ODD_CHAR_TIC2_BA /\'[\`\_\.\^\-,\~]/
SS> describe ODD_CHAR_TIC2_BA Odd combo of special chars
SS> score ODD_CHAR_TIC2_BA .6

SS> body ODD_CHAR_TILDE_BA /\~[\'\`\_\.\^\-,\~]/
SS> describe ODD_CHAR_TILDE_BA Odd combo of special chars
SS> score ODD_CHAR_TILDE_BA .6

SS> body ODD_CHAR_COMMA_BA /,[\~\'\`\_\.\^\-]/
SS> describe ODD_CHAR_COMMA_BA Odd combo of special chars
SS> score ODD_CHAR_COMMA_BA .6

SS> Sandy
SS> ----- Original Message ----- 
SS> From: "Thomas Kinghorn" <th...@mtnns.net>
SS> To: <sp...@incubator.apache.org>
SS> Sent: Tuesday, August 03, 2004 5:38 AM
SS> Subject: more are more junk getting through


>> Hi List
>>
>> I have had a dramatic increase in junk mail,
>>
>> I am using SA 2.63 with SURBL.
>> MTA is exim 4.34 using sa-exim-4
>>
>> I have attached a sample.
>>
>> Subjects and originating IP's are always different
>> But the formatting of the body is similar.
>>
>> Any ideas would be appreciated.
>>
>>  <<important increased muscle mass without exercise.msg>>
>>
>> Regards,
>>
>> Tom Kinghorn
>>
>>





-- 
Best regards,
 Robert                            mailto:Robert@Menschel.net



Is something wrong with our Bayes?

Posted by Amnon <am...@deltaforce.net>.
Since Saturday evening, I got a few calls from clients saying that their
email to me was returned to them as UBE.  We are using
amavisd/postfix/spamassassin.  I changed the configuration to NOT DELETE on
the server (we have it so users can check a box and anything over 10 gets
deleted on the server) and asked a few of those who had their email bounced
to send it again so that I could see the scores.  I noticed that all of them
had a BAYES_99 score, even email of a whitelisted users.

I lowered BAYES_99 to 1.0 (had it on 10.1).  Another weird thing is that the
score in the headers for BAYES_99 was 10 and not 10.1 like it is in the
config file, or 10.0 like the format of all all the other scores.

Is bayes screwed up?

Shalom Ya'll
Amnon Nissan

Deltaforce
919-852-2121
http://www.deltaforce.net

Host, Computers 2K4
on 850 The Buzz  (AM 850) in Raleigh NC
Sundays 8-10am
http://www.850thebuzz.com/compute.html

MV stuff are at:
  http://www.deltaforce.net/deuce/
  http://www.ncmvpa.com


Re: more are more junk getting through

Posted by Sandy S <sa...@boreal.org>.
Tom  -
I've seen these too, and have put in the following rules to try and catch
them.  They've helped, but a few are still slipping through.  I think if you
raise the scores some they'd catch a lot more, but I need to be a little
more sure I won't get FPs before I do this!

body ODD_CHAR_DASH_BA /\-[,\~\'\`\_\.\^]/
describe ODD_CHAR_DASH_BA Odd combo of special chars
score ODD_CHAR_DASH_BA .6

body ODD_CHAR_CARET_BA /\^[\-,\~\'\`\_\.\^]/
describe ODD_CHAR_CARET_BA Odd combo of special chars
score ODD_CHAR_CARET_BA .6

body ODD_CHAR_DOT_BA /\.[\^\~\'\`\_]/
describe ODD_CHAR_DOT_BA Odd combo of special chars
score ODD_CHAR_DOT_BA .6

body ODD_CHAR_UNDERSCORE_BA /\_[\.\^\-,\~\'\`]/
describe ODD_CHAR_UNDERSCORE_BA Odd combo of special chars
score ODD_CHAR_UNDERSCORE_BA .6

body ODD_CHAR_TIC1_BA /\`[\_\.\^\-,\~\']/
describe ODD_CHAR_TIC1_BA Odd combo of special chars
score ODD_CHAR_TIC1_BA .6

body ODD_CHAR_TIC2_BA /\'[\`\_\.\^\-,\~]/
describe ODD_CHAR_TIC2_BA Odd combo of special chars
score ODD_CHAR_TIC2_BA .6

body ODD_CHAR_TILDE_BA /\~[\'\`\_\.\^\-,\~]/
describe ODD_CHAR_TILDE_BA Odd combo of special chars
score ODD_CHAR_TILDE_BA .6

body ODD_CHAR_COMMA_BA /,[\~\'\`\_\.\^\-]/
describe ODD_CHAR_COMMA_BA Odd combo of special chars
score ODD_CHAR_COMMA_BA .6

Sandy
----- Original Message ----- 
From: "Thomas Kinghorn" <th...@mtnns.net>
To: <sp...@incubator.apache.org>
Sent: Tuesday, August 03, 2004 5:38 AM
Subject: more are more junk getting through


> Hi List
>
> I have had a dramatic increase in junk mail,
>
> I am using SA 2.63 with SURBL.
> MTA is exim 4.34 using sa-exim-4
>
> I have attached a sample.
>
> Subjects and originating IP's are always different
> But the formatting of the body is similar.
>
> Any ideas would be appreciated.
>
>  <<important increased muscle mass without exercise.msg>>
>
> Regards,
>
> Tom Kinghorn
>
>



Re: more are more junk getting through

Posted by Jim Maul <jm...@elih.org>.
Quoting Marc Kool <M....@vioro.nl>:

> Tom,
>
> It's a little off topic:
> I recently implemented greylisting and sender address verification
> and stopped 80+ % of spam at the MTA (postfix in my case).
>
> I can recommend it to everybody.
>
> -Marc
>

And REALLY Off topic:

Did anyone ever tell you that the c and K are reversed in your name? ;)

Jim

Re: more are more junk getting through

Posted by Marc Kool <M....@vioro.nl>.
Tom,

It's a little off topic:
I recently implemented greylisting and sender address verification
and stopped 80+ % of spam at the MTA (postfix in my case).

I can recommend it to everybody.

-Marc


Thomas Kinghorn wrote:
> Hi List
> 
> I have had a dramatic increase in junk mail,
> 
> I am using SA 2.63 with SURBL.
> MTA is exim 4.34 using sa-exim-4
> 
> I have attached a sample.
> 
> Subjects and originating IP's are always different
> But the formatting of the body is similar.
> 
> Any ideas would be appreciated.
> 
>  <<important increased muscle mass without exercise.msg>> 
> 
> Regards, 
> 
> Tom Kinghorn



Re: more are more junk getting through

Posted by Duncan Hill <sa...@nacnud.force9.co.uk>.
On Tuesday 03 August 2004 11:38, Thomas Kinghorn might have typed:

> Any ideas would be appreciated.
>
>  <<important increased muscle mass without exercise.msg>>

Binary, proprietary message format.  Unreadable apart from passing it to the 
strings command in the vague hope that it contains something useful.