You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by snowcrash+spamassassin <sc...@gmail.com> on 2007/02/04 03:44:05 UTC
SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
hi,
when i receive a message that's passed through SpamAssassin, if i
view the Message Source in any client, i see a correctly/expected
formatted report, e.g:
----------------------------------------------------------
X-Spam-Checker-Version: SpamAssassin 3.1.8-r454679 (2006-10-10)
X-Spam-Level: !!!!!!!!!!!!!!!!!
X-Spam-Status: score=17.5/4.0 autolearn=spam
X-Spam-Report:
* 1.1 EXTRA_MPART_TYPE Header has extraneous Content-type:...type= entry
* 0.0 DK_POLICY_SIGNSOME Domain Keys: policy says domain signs
some mails
* 5.0 BOTNET Relay might be a spambot or virusbot
* [botnet0.7,ip=208.103.1.19,hostname=208.103.0.19.etczone.com,baddns,client,ipinhostname]
* 0.1 TW_CX BODY: Odd Letter Triples with CX
* 0.1 TW_GW BODY: Odd Letter Triples with GW
* 0.1 TW_MK BODY: Odd Letter Triples with MK
* 0.1 TW_BJ BODY: Odd Letter Triples with BJ
* 0.1 TW_JM BODY: Odd Letter Triples with JM
* 0.1 TW_UW BODY: Odd Letter Triples with UW
* 0.1 TW_PW BODY: Odd Letter Triples with PW
* 0.1 TW_IU BODY: Odd Letter Triples with IU
* 0.1 TW_YJ BODY: Odd Letter Triples with YJ
* 0.1 TW_DB BODY: Odd Letter Triples with DB
* 0.0 HTML_MESSAGE BODY: HTML included in message
* 3.1 HTML_IMAGE_ONLY_08 BODY: HTML: images with 400-800 bytes of words
* 1.5 BAYES_50 BODY: Bayesian spam probability is 40 to 60%
* [score: 0.5531]
* 6.0 FUZZY_OCR BODY: Img with common spam text inside
* Words found:
* "cialis" in 1 lines
* "viagra" in 1 lines
* "cialis" in 1 lines
* "viagra" in 1 lines
* (4 word occurrences found)
----------------------------------------------------------
if i open the message in, e.g. Mulberry, and view 'all' headers, i see a
similarly formatted:
----------------------------------------------------------
X-Spam-Level: !!!!!!!!!!!!!!!!!
X-Spam-Status: score=17.5/4.0 autolearn=spam
X-Spam-Report:
* 1.1 EXTRA_MPART_TYPE Header has extraneous Content-type:...type= entry
* 0.0 DK_POLICY_SIGNSOME Domain Keys: policy says domain signs
some mails
* 5.0 BOTNET Relay might be a spambot or virusbot
* [botnet0.7,ip=208.103.1.19,hostname=208.103.0.19.etczone.com,baddns,client,ipinhostname]
* 0.1 TW_CX BODY: Odd Letter Triples with CX
* 0.1 TW_GW BODY: Odd Letter Triples with GW
* 0.1 TW_MK BODY: Odd Letter Triples with MK
* 0.1 TW_BJ BODY: Odd Letter Triples with BJ
* 0.1 TW_JM BODY: Odd Letter Triples with JM
* 0.1 TW_UW BODY: Odd Letter Triples with UW
* 0.1 TW_PW BODY: Odd Letter Triples with PW
* 0.1 TW_IU BODY: Odd Letter Triples with IU
* 0.1 TW_YJ BODY: Odd Letter Triples with YJ
* 0.1 TW_DB BODY: Odd Letter Triples with DB
* 0.0 HTML_MESSAGE BODY: HTML included in message
* 3.1 HTML_IMAGE_ONLY_08 BODY: HTML: images with 400-800 bytes of words
* 1.5 BAYES_50 BODY: Bayesian spam probability is 40 to 60%
* [score: 0.5531]
* 6.0 FUZZY_OCR BODY: Img with common spam text inside
* Words found:
* "cialis" in 1 lines
* "viagra" in 1 lines
* "cialis" in 1 lines
* "viagra" in 1 lines
* (4 word occurrences found)
----------------------------------------------------------
BUT, if i open the message in Thunderbird2, the line-breaks in the
header are apparently stripped off; here's what it looks like.
http://img100.imageshack.us/img100/278/mnenhyallheaderswh1.jpg
In troubleshooting this, i was informed about the Mozilla MailNews
backend, that TBird is using,
> As per RfC (2)822, header _values_ are always just *one* line.
> To get around the (server) restriction of 998 usable characters per
> line, it is allowed to split the value into multiple lines. But these
> line breaks are *not* part of the actual value and recipients have to
> remove the line breaks when decoding the message to get back the real
> value. If the the value should contain line breaks, these have to be
> encoded before, eg. as =0A in the Quoted Printable encoding.
>
> The X-Spam-Result header value is not encoded, thus the line breaks used
> as a formatting in the source are *not* part of the value and *must* be
> stripped before passing the value to the frontend.
>
> The MailNews backend handling is correct.
Since this is the same message, retrieved from the same mail server,
and, therefore, having been processed by the same instance of SA, i'm
guessing this has to do with what the SA report-generating step does.
But, i'm not certain of that ...
That said, can someone chime in here, and perhaps suggest where to
look / what to do about this?
thanks.
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> version 1.5.0.9 (20070104) is what I use. I do build it from source but
> that shouldn't make any difference.
i've never successfully managed a build of anything-mozilla. not that
it's a priority ...
> I try to avoid pre-releases for
> things such as T-Bird/Firefox and am not sure you could actually revert
> back to the 1.5.0.9 stable version.
FF2 & Tbird2 have been, generally, far more stable for me than their
15x counterparts ... but, yes, "it's a beta".
> Looks like there are some options gone missing in the 2.x branch. ::sigh::
alas, yes.
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Doc Schneider <ma...@maddoc.net>.
snowcrash wrote:
> oops ... that was for FF.
>
> this is for TB,
>
> Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.2pre)
> Gecko/20070203 Thunderbird/2.0pre Mnenhy/0.7.4.10005
version 1.5.0.9 (20070104) is what I use. I do build it from source but
that shouldn't make any difference. I try to avoid pre-releases for
things such as T-Bird/Firefox and am not sure you could actually revert
back to the 1.5.0.9 stable version.
Looks like there are some options gone missing in the 2.x branch. ::sigh::
--
-Doc
Penguins: Do it on the ice.
11:04am up 1 day, 2:30, 17 users, load average: 1.16, 0.86, 0.68
SARE HQ http://www.rulesemporium.com/
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash <sc...@gmail.com>.
oops ... that was for FF.
this is for TB,
Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.2pre)
Gecko/20070203 Thunderbird/2.0pre Mnenhy/0.7.4.10005
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> Is that the OS X version?
yes, it is.
> Plus what version of t-bird are you using?
Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.2pre)
Gecko/20070203 BonEcho/2.0.0.2pre
> I
> use the linux version and mine has a lot more under that option than
> yours is showing. Go figure.
:-/
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Doc Schneider <ma...@maddoc.net>.
snowcrash+spamassassin wrote:
>> In T-Bird under preferences->Display under the "Formatting" tab. wrap
>> test to fit window width. I believe it is checked by default.
>
> hm. don't have "one of those",
>
> http://img401.imageshack.us/img401/8435/tbirdtabuj4.png
>
> haven't found it elsewhere either (yet ...) :-/
Is that the OS X version? Plus what version of t-bird are you using? I
use the linux version and mine has a lot more under that option than
yours is showing. Go figure.
--
-Doc
Penguins: Do it on the ice.
8:20am up 23:46, 17 users, load average: 1.59, 1.00, 0.68
SARE HQ http://www.rulesemporium.com/
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> In T-Bird under preferences->Display under the "Formatting" tab. wrap
> test to fit window width. I believe it is checked by default.
hm. don't have "one of those",
http://img401.imageshack.us/img401/8435/tbirdtabuj4.png
haven't found it elsewhere either (yet ...) :-/
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Doc Schneider <ma...@maddoc.net>.
snowcrash+spamassassin wrote:
>> There is nothing SpamAssassin related here. The information in the
>> header is
>> written w/ whitespace folding. Most MUAs leave it alone when showing
>> it to
>> you, Thunderbird apparently unfolds the lines.
>>
>> You may have an option which lets you disable it, but it's 100% a mail
>> client
>> issue.
>
> ok.
>
> so far, googling, i haven't even found mention of the issue/problem,
> let alone a fix/option to turn it off. :-/
>
> if anyone _here_ sees the problem in tbird, i'd appreciate hearing about
> it.
>
> thanks.
In T-Bird under preferences->Display under the "Formatting" tab. wrap
test to fit window width. I believe it is checked by default.
It isn't any bother to me but it does effect the wrapping lines.
--
-Doc
Penguins: Do it on the ice.
10:28pm up 13:54, 15 users, load average: 0.10, 0.42, 0.42
SARE HQ http://www.rulesemporium.com/
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> There is nothing SpamAssassin related here. The information in the header is
> written w/ whitespace folding. Most MUAs leave it alone when showing it to
> you, Thunderbird apparently unfolds the lines.
>
> You may have an option which lets you disable it, but it's 100% a mail client
> issue.
ok.
so far, googling, i haven't even found mention of the issue/problem,
let alone a fix/option to turn it off. :-/
if anyone _here_ sees the problem in tbird, i'd appreciate hearing about it.
thanks.
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by Theo Van Dinter <fe...@apache.org>.
On Sat, Feb 03, 2007 at 06:44:05PM -0800, snowcrash+spamassassin wrote:
> Since this is the same message, retrieved from the same mail server,
> and, therefore, having been processed by the same instance of SA, i'm
> guessing this has to do with what the SA report-generating step does.
> But, i'm not certain of that ...
>
> That said, can someone chime in here, and perhaps suggest where to
> look / what to do about this?
There is nothing SpamAssassin related here. The information in the header is
written w/ whitespace folding. Most MUAs leave it alone when showing it to
you, Thunderbird apparently unfolds the lines.
You may have an option which lets you disable it, but it's 100% a mail client
issue.
--
Randomly Selected Tagline:
"Don`t knock the weather. If it didn`t change once in a while, nine out
of ten people couldn`t start a conversation." - Kim Hubbard
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash <sc...@gmail.com>.
<agreed><pedantic><snip></pedantic></agreed>
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Kelson <ke...@speed.net>.
snowcrash+spamassassin wrote:
> whatever. currently, it's unformatted in tbird, unlike in other
> clients. intended, or not; bug, or not -- that's a fact.
<pedantic>Technically, it's left unformatted in those other clients, and
has been reformatted according to specs by Thunderbird.</pedantic>
--
Kelson Vibber
SpeedGate Communications <www.speed.net>
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Andy Figueroa <fi...@andyfigueroa.us>.
Jim Maul wrote:
> Is ctrl-U not sufficient?
Jim, that's quite wonderful. Thank you. That knocks me down a few rungs
on the pole. I hadn't found it (I know I should have, it's on the "view"
menu, duh, like in Firefox.). I'm just a tyro with these GUI
applications. That removes my major complaint about TB.
And, I have no complaint about how SA formats the header.
Andy
> Andy Figueroa wrote:
>> As an occasional, long-term Thunderbird user, and using a reasonably
>> current version, 1.5.0.9, TB doesn't even have a built-in show header
>> feature. It can be added with a buggy extension called View Headers
>> Toggle Button, which doesn't show long lines without scrolling (scroll
>> right and left by dragging the mouse over the long line) and doesn't
>> show all of a long header with no vertical scrolling available. So,
>> if SpamAssassin formatted it's headers so they were pretty, with TB
>> you'd see even less of the header because pretty formatting adds lines.
>>
>> This is a missing feature in TB, poorly added with the extant
>> extension. When my leg heals I'll go back to using KMail on my
>> desktop computer and be happy about it. :-)
>>
>> Andy Figueroa
>>
>
> Is ctrl-U not sufficient?
>
> -Jim
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Jim Maul <jm...@elih.org>.
Andy Figueroa wrote:
> As an occasional, long-term Thunderbird user, and using a reasonably
> current version, 1.5.0.9, TB doesn't even have a built-in show header
> feature. It can be added with a buggy extension called View Headers
> Toggle Button, which doesn't show long lines without scrolling (scroll
> right and left by dragging the mouse over the long line) and doesn't
> show all of a long header with no vertical scrolling available. So, if
> SpamAssassin formatted it's headers so they were pretty, with TB you'd
> see even less of the header because pretty formatting adds lines.
>
> This is a missing feature in TB, poorly added with the extant extension.
> When my leg heals I'll go back to using KMail on my desktop computer
> and be happy about it. :-)
>
> Andy Figueroa
>
Is ctrl-U not sufficient?
-Jim
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Andy Figueroa <fi...@andyfigueroa.us>.
As an occasional, long-term Thunderbird user, and using a reasonably
current version, 1.5.0.9, TB doesn't even have a built-in show header
feature. It can be added with a buggy extension called View Headers
Toggle Button, which doesn't show long lines without scrolling (scroll
right and left by dragging the mouse over the long line) and doesn't
show all of a long header with no vertical scrolling available. So, if
SpamAssassin formatted it's headers so they were pretty, with TB you'd
see even less of the header because pretty formatting adds lines.
This is a missing feature in TB, poorly added with the extant extension.
When my leg heals I'll go back to using KMail on my desktop computer
and be happy about it. :-)
Andy Figueroa
snowcrash+spamassassin wrote:
>> > bottom line -- SA works perfectly; tbird's display of SA headers is
>> shoddy.
>>
>> Actually: If SA's header does not have encoded newlines in it,
>> SAs header is shoddy (or, more likely, SA's header is formatted
>> to look nice when viewing the message source) and TB (as well as
>> other mail readers) displays it correctly.
>
> that's the point ... 'other' clients display it 'properly'.
>
> _only_ tbird does not.
>
>> If you want the behaviour of Thunderbird to change, it is
>> possible that a feature request to have the option to display
>> headers the way you want might be more fruitful than a request to
>> fix a non-existant bug. :-)
>
> though i'd like tbird to behave like other clients ... and format
> those long-line headers correctly/neatly/as-intended, i've spent too
> much time already trying to convince anyone its's "an issue", and keep
> getting 'debates'.
>
> whatever. currently, it's unformatted in tbird, unlike in other
> clients. intended, or not; bug, or not -- that's a fact.
>
> it looks shoddy compared to other clients. that's just an opinion ...
>
>> But first, check if there's any hidden preference that allready
>> does what you want. After all, the Mozilla apps are full of
>> preferences you can only add or change through the Config Editor.
>
> already did. myself, and questioning others who know much more abt the
> internals.
>
> short answer (so far) -- there's no such option.
>
> thanks.
>
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> > bottom line -- SA works perfectly; tbird's display of SA headers is shoddy.
>
> Actually: If SA's header does not have encoded newlines in it,
> SAs header is shoddy (or, more likely, SA's header is formatted
> to look nice when viewing the message source) and TB (as well as
> other mail readers) displays it correctly.
that's the point ... 'other' clients display it 'properly'.
_only_ tbird does not.
> If you want the behaviour of Thunderbird to change, it is
> possible that a feature request to have the option to display
> headers the way you want might be more fruitful than a request to
> fix a non-existant bug. :-)
though i'd like tbird to behave like other clients ... and format
those long-line headers correctly/neatly/as-intended, i've spent too
much time already trying to convince anyone its's "an issue", and keep
getting 'debates'.
whatever. currently, it's unformatted in tbird, unlike in other
clients. intended, or not; bug, or not -- that's a fact.
it looks shoddy compared to other clients. that's just an opinion ...
> But first, check if there's any hidden preference that allready
> does what you want. After all, the Mozilla apps are full of
> preferences you can only add or change through the Config Editor.
already did. myself, and questioning others who know much more abt the
internals.
short answer (so far) -- there's no such option.
thanks.
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Jonas Eckerman <jo...@frukt.org>.
snowcrash+spamassassin wrote:
> bottom line -- SA works perfectly; tbird's display of SA headers is shoddy.
Actually: If SA's header does not have encoded newlines in it,
SAs header is shoddy (or, more likely, SA's header is formatted
to look nice when viewing the message source) and TB (as well as
other mail readers) displays it correctly.
In a mail message, a CRLF followed by a whitespace is just a
continuation of the header, not a line break. When displaying the
header, it's up to the displaying software how to wrap the
header. It's perfectly valid to keep the continuations as line
brakes, but it's also perfectly valid to display it as one long
line or rewrapped with line breaks wherever the displaying
software wants them to be.
This becomes more obvious when considering long (often MIME
encoded) subjects that has been wrapped in order to keep the line
length down even though the author did wrote it as one long
subject line.
When displaying those subjects, lines should not be broken just
because the mail client used to write the mail inserted
continuation characters before sending it.
If you want the behaviour of Thunderbird to change, it is
possible that a feature request to have the option to display
headers the way you want might be more fruitful than a request to
fix a non-existant bug. :-)
But first, check if there's any hidden preference that allready
does what you want. After all, the Mozilla apps are full of
preferences you can only add or change through the Config Editor.
Regards
/Jonas
--
Jonas Eckerman, FSDB & Fruktträdet
http://whatever.frukt.org/
http://www.fsdb.org/
http://www.frukt.org/
Re: SA-gen'd message report headers appear differently (with/without linebreaks) in different mail clients
Posted by snowcrash+spamassassin <sc...@gmail.com>.
> From your screen shot, I'm guessing you're looking at it via
> View->Headers->All.
actually, in any/all header 'views' ...
> You can see the original formatting (even in
> Thunderbird 2) using the Message Source function instead.
yup, aware of that. that's not the issue though ... rather, it's the
'mis'-display of the header in the header-views. bug's been reported
to mozilla; 'discussion' there about "is it a bug, even though every
OTHER client handles it correctly ..." etc etc
honetsly, if 'they' don't want to fix it -- or even ackonwledge it --
there are alternative (like u say, MessageSource, or better yet, use a
different mua/client).
bottom line -- SA works perfectly; tbird's display of SA headers is shoddy.
oh well.
thanks.
Re: SA-gen'd message report headers appear differently (with/without
linebreaks) in different mail clients
Posted by Kelson <ke...@speed.net>.
snowcrash+spamassassin wrote:
> BUT, if i open the message in Thunderbird2, the line-breaks in the
> header are apparently stripped off; here's what it looks like.
...
> > As per RfC (2)822, header _values_ are always just *one* line.
> > To get around the (server) restriction of 998 usable characters per
> > line, it is allowed to split the value into multiple lines. But these
> > line breaks are *not* part of the actual value and recipients have to
> > remove the line breaks when decoding the message to get back the real
> > value.
From your screen shot, I'm guessing you're looking at it via
View->Headers->All. You can see the original formatting (even in
Thunderbird 2) using the Message Source function instead.
Menu: View->Message Source
Keyboard: Ctrl+U on Windows & Linux, probably Cmd+U on Mac
--
Kelson Vibber
SpeedGate Communications <www.speed.net>