You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Bob Gereford <bg...@gmail.com> on 2008/08/20 17:33:13 UTC

SA scores "MISSING_SUBJECT", but message _has_ a Subject

I've received a message with a Subject of

    "Be Serious and Have Fun!"

Looking at the headers

    Return-Path: <bo...@OperationsLadder.com>
    X-Spam-Flag: YES
    X-Spam-Level: !!!!!!!
    X-Spam-Status: score=7.8/4.0 autolearn=spam
    X-Spam-Report:
        *  4.0 URIBL_BLACK Contains an URL listed in the URIBL blacklist
        *      [URIs: howtodothings.com]
        *  0.0 HTML_MESSAGE BODY: HTML_MESSAGE
        *  1.5 BODY_8BITS BODY: Body includes 8 consecutive 8-bit characters
        *  2.2 DCC_CHECK Listed in DCC (http://rhyolite.com/anti-spam/dcc/)
        *  1.8 MISSING_SUBJECT MISSING_SUBJECT
        *  1.4 EMPTY_MESSAGE EMPTY_MESSAGE
        * -0.0 NO_RECEIVED NO_RECEIVED
        * -3.1 AWL AWL: From: address is in the auto white-list

    Return-Path: bounces@OperationsLadder.com
    Date: Wed, 20 Aug 2008 06:53:19 -0400 (EDT)
    From: "TheLadders.com" <jo...@OperationsLadder.com>
    Reply-To: "TheLadders.com" <jo...@OperationsLadder.com>

    Subject: Be Serious and Have Fun!
    MIME-Version: 1.0

Spamassassin scores the message

    *  1.8 MISSING_SUBJECT MISSING_SUBJECT

for not having a Subject line. ??

I found an apparently related bug that says RESOLVED

    "MISSING_SUBJECT is wrong"
    https://issues.apache.org/SpamAssassin/show_bug.cgi?id=5207

but I honestly can't understand the "resolution".

Like in the bug, I've checked the message with

    spamassassin -LD check 4589 >& /dev/null

and see no errors.

Why is SA saying my message has no "Subject"?

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by mouss <mo...@netoyen.net>.
Bob Gereford wrote:
> Hi John,
> 
> On Wed, Aug 20, 2008 at 8:59 AM, John Hardin <jh...@impsec.org> wrote:
> 
>> Is that blank line actually present within the message headers?
> 
> 
> No, just an artifact from my copy & paste -- I removed header lines with
> personally identifiable / account info.
> 
> If at all relevant, I just received another legit message and, despite
> having both a Subject & Message that are apparently valid, the spam score
> includes:
> 
>  1.8 MISSING_SUBJECT MISSING_SUBJECT
>  1.4 EMPTY_MESSAGE EMPTY_MESSAGE
> 
> Clearly, something's not right here ... :-(
> 

there may be a CRLF issue (CRLF vs LF vs CR). so even pasting won't help.



Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Bob Gereford <bg...@gmail.com>.
After finding my reading-glasses, I sat down to read the cgpsa
documentation, as well as the Communigate docs.

And, found the problem.  Nothing to do with SA's cf files (which all
were --lint-ing correctly), but rather with the "cgpsa" perl script.

It seems it has two modes:
(1) "header-only", where the script circumvents the PIPE mechanism,
writing its own headers, and
(2) "full", where the SA functionality is not tampered with, and
headers are touched/written ONLY by SA.

The server *was* running in mode (1), now it's running in mode (2).

So far, no more MISSING_ or EMTPY_ scores of any kind.

I'll wait and see a bit ... but, looks like letting SA do its thing is
all that was required.

Thanks for the comments.

(off to have YA-chat w/ 'Billy' ...)

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Bob Gereford <bg...@gmail.com>.
On Wed, Aug 20, 2008 at 10:17 AM, Theo Van Dinter <fe...@apache.org> wrote:
>
> I was noticing that the X-Spam headers as posted aren't in the standard
> format (X-Spam-Status), nor is there a X-Spam-Checker-Version header which
> makes me think you're not calling SA directly to process the mails.  So how
> are you sending mails to SA?


Well, part of the problem is that it's not "me" doing the calling ...
rather "Billy, the Mail Admin" is 'in charge' (i'm really coming to
know & love Billy!).

He says "I call SA with Communicate Pro server's CGPSA perl module".

I'm not really sure what that means ... or if it has an effect here.
I'm guessing it does :-/

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Theo Van Dinter <fe...@apache.org>.
On Wed, Aug 20, 2008 at 09:34:34AM -0700, Bob Gereford wrote:
> Here's the paste of the "raw message" content from the last message
> http://pastebin.com/d57d0894d

Yeah, nothing strange there.  Passing it through "spamassassin" shows what
you'd expect:

X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,RDNS_NONE,SPF_FAIL,
        SPF_HELO_PASS autolearn=disabled version=3.2.5

I was noticing that the X-Spam headers as posted aren't in the standard
format (X-Spam-Status), nor is there a X-Spam-Checker-Version header which
makes me think you're not calling SA directly to process the mails.  So how
are you sending mails to SA?

-- 
Randomly Selected Tagline:
"Commitment can be illustrated by a breakfast of ham and eggs.
 The chicken was involved, but the pig was committed" - Unknown

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Bob Gereford <bg...@gmail.com>.
Hi Theo,

On Wed, Aug 20, 2008 at 9:22 AM, Theo Van Dinter <fe...@apache.org>wrote:

> If you think there's an issue, feel free to pastebot the message somewhere
> and
> folks can take a look.  Otherwise there's not much people are going to be
> able
> to comment on.
>
> My guess is that however you're feeding mails into SA is having issues.
>

Here's the paste of the "raw message" content from the last message

http://pastebin.com/d57d0894d

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Theo Van Dinter <fe...@apache.org>.
If you think there's an issue, feel free to pastebot the message somewhere and
folks can take a look.  Otherwise there's not much people are going to be able
to comment on.

My guess is that however you're feeding mails into SA is having issues.

On Wed, Aug 20, 2008 at 09:18:37AM -0700, Bob Gereford wrote:
> If at all relevant, I just received another legit message and, despite
> having both a Subject & Message that are apparently valid, the spam score
> includes:
> 
>  1.8 MISSING_SUBJECT MISSING_SUBJECT
>  1.4 EMPTY_MESSAGE EMPTY_MESSAGE
> 
> Clearly, something's not right here ... :-(

-- 
Randomly Selected Tagline:
Cats are smarter than dogs.  You can't make eight cats pull a sled through
 the snow.

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Bob Gereford <bg...@gmail.com>.
Hi John,

On Wed, Aug 20, 2008 at 8:59 AM, John Hardin <jh...@impsec.org> wrote:

> Is that blank line actually present within the message headers?


No, just an artifact from my copy & paste -- I removed header lines with
personally identifiable / account info.

If at all relevant, I just received another legit message and, despite
having both a Subject & Message that are apparently valid, the spam score
includes:

 1.8 MISSING_SUBJECT MISSING_SUBJECT
 1.4 EMPTY_MESSAGE EMPTY_MESSAGE

Clearly, something's not right here ... :-(

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by John Hardin <jh...@impsec.org>.
On Wed, 20 Aug 2008, Bob Gereford wrote:

>    Date: Wed, 20 Aug 2008 06:53:19 -0400 (EDT)
>    From: "TheLadders.com" <jo...@OperationsLadder.com>
>    Reply-To: "TheLadders.com" <jo...@OperationsLadder.com>
>
>    Subject: Be Serious and Have Fun!
>    MIME-Version: 1.0

Is that blank line actually present within the message headers?

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Windows Vista: Windows ME for the XP generation.
-----------------------------------------------------------------------
  4 days until the 1929th anniversary of the destruction of Pompeii

Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Karsten Bräckelmann <gu...@rudersport.de>.
On Wed, 2008-08-20 at 08:33 -0700, Bob Gereford wrote:

>     X-Spam-Report: 
>         *  4.0 URIBL_BLACK Contains an URL listed in the URIBL blacklist
>         *      [URIs: howtodothings.com]
>         *  0.0 HTML_MESSAGE BODY: HTML_MESSAGE
>         *  1.5 BODY_8BITS BODY: Body includes 8 consecutive 8-bit characters

>         *  1.8 MISSING_SUBJECT MISSING_SUBJECT
>         *  1.4 EMPTY_MESSAGE EMPTY_MESSAGE

So the message body does contain a URL and "consecutive chars", but it
is empty nonetheless? Oh, yeah... :)


> Spamassassin scores the message
>     *  1.8 MISSING_SUBJECT MISSING_SUBJECT
> 
> for not having a Subject line. ??

And it got a body...


> I found an apparently related bug that says RESOLVED
> 
>     "MISSING_SUBJECT is wrong"
>     https://issues.apache.org/SpamAssassin/show_bug.cgi?id=5207
> 
> but I honestly can't understand the "resolution".

Please read the comments carefully. The resolution would be somewhere
between WORKSFORME (see comment 5) and INVALID (see comment 6). The
first one tells that Theo was not able to reproduce the bug, and the
latter clearly explains why it is not a bug -- the reporter had broken
cf files, that lead to this.


> Like in the bug, I've checked the message with
>     spamassassin -LD check 4589 >& /dev/null
> 
> and see no errors.

See comment 6. Carefully check all the output for warnings. Lint test
your config files.

My guess is, there is a problem with your cf or user_prefs files just
like with that report. How else can an "empty message" contain chars? :)

  guenther


-- 
char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4";
main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1:
(c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}


Re: SA scores "MISSING_SUBJECT", but message _has_ a Subject

Posted by Duane Hill <d....@yournetplus.com>.
On Wed, 20 Aug 2008, Bob Gereford wrote:

> I've received a message with a Subject of
>
>     "Be Serious and Have Fun!"
> 
> Looking at the headers
>
>     Return-Path: <bo...@OperationsLadder.com>
>     X-Spam-Flag: YES
>     X-Spam-Level: !!!!!!!
>     X-Spam-Status: score=7.8/4.0 autolearn=spam
>     X-Spam-Report:
>         *  4.0 URIBL_BLACK Contains an URL listed in the URIBL blacklist
>         *      [URIs: howtodothings.com]
>         *  0.0 HTML_MESSAGE BODY: HTML_MESSAGE
>         *  1.5 BODY_8BITS BODY: Body includes 8 consecutive 8-bit characters
>         *  2.2 DCC_CHECK Listed in DCC (http://rhyolite.com/anti-spam/dcc/)
>         *  1.8 MISSING_SUBJECT MISSING_SUBJECT
>         *  1.4 EMPTY_MESSAGE EMPTY_MESSAGE
>         * -0.0 NO_RECEIVED NO_RECEIVED
>         * -3.1 AWL AWL: From: address is in the auto white-list
>
>     Return-Path: bounces@OperationsLadder.com
>     Date: Wed, 20 Aug 2008 06:53:19 -0400 (EDT)
>     From: "TheLadders.com" <jo...@OperationsLadder.com>
>     Reply-To: "TheLadders.com" <jo...@OperationsLadder.com>
>
>     Subject: Be Serious and Have Fun!
>     MIME-Version: 1.0
> 
> Spamassassin scores the message
>
>     *  1.8 MISSING_SUBJECT MISSING_SUBJECT
> 
> for not having a Subject line. ??

Looking down your headers (that is _IF_ they are as you have shown above), 
there is a blank line just after the X-Spam-Report lines. Once that blank 
line is hit, all the rest is considered the body of the message. 
Therefore, SpamAssassin has scored for a missing subject.

> I found an apparently related bug that says RESOLVED
>
>     "MISSING_SUBJECT is wrong"
>     https://issues.apache.org/SpamAssassin/show_bug.cgi?id=5207
> 
> but I honestly can't understand the "resolution".
> 
> Like in the bug, I've checked the message with
>
>     spamassassin -LD check 4589 >& /dev/null
> 
> and see no errors.
> 
> Why is SA saying my message has no "Subject"?

-d