You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2006/12/07 16:39:39 UTC

[Bug 5226] New: FP from 80_additional on OE embedded images

http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226

           Summary: FP from 80_additional on OE embedded images
           Product: Spamassassin
           Version: 3.1.7
          Platform: Other
        OS/Version: other
            Status: NEW
          Severity: normal
          Priority: P5
         Component: Rules
        AssignedTo: dev@spamassassin.apache.org
        ReportedBy: richard.frovarp@sendit.nodak.edu


I am seeing FPs due to several very high scoring rules firing on messages sent
from Outlook Express with embedded images, usually gifs. I have reduced the
scores of the rules and have helped eliminate the issue. Below is the report of
rules hit for the message. The INFO_TLD comes from the fact the message has a
signature that contains www.mailscaner.info in it.

score = 8.98
-1.44 ALL_TRUSTED
0.81 EXTRA_MPART_TYPE
0.00 HTML_MESSAGE
0.81 INFO_TLD
2.00 PART_CID_STOCK 
2.00 PART_CID_STOCK_LESS 
2.80 TVD_FW_GRAPHIC_ID1 
2.00 TVD_FW_MESG1



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From grin@grin.hu  2007-04-11 08:06 -------
I got bumped into those several times, people were sending pics from outlook and
got bounced. It's like:

        Content analysis details:   (6.7 points, 5.0 required)
        pts rule name              description
        ---- ----------------------
--------------------------------------------------
        1.1 EXTRA_MPART_TYPE       Header has extraneous Content-type:...type= entry
        -1.8 ALL_TRUSTED            Passed through trusted hosts only via SMTP
        1.2 HTML_IMAGE_ONLY_20     BODY: HTML: images with 1600-2000 bytes of words
        2.1 TVD_FW_GRAPHIC_ID1     BODY: TVD_FW_GRAPHIC_ID1
        0.3 HTML_COMMENT_SAVED_URL BODY: HTML message is a saved web page
        -2.6 BAYES_00               BODY: Bayesian spam probability is 0 to 1%
        [score: 0.0000]
        1.5 HTML_MESSAGE           BODY: HTML included in message
        1.0 STOCK_IMG_OUTLOOK      Stock spam image part, with Outlook-like features
        1.0 PART_CID_STOCK         Has a spammy image attachment (by Content-ID)
        1.0 PART_CID_STOCK_LESS    Has a spammy image attachment (by Content-ID,
        more specific)
        1.0 STOCK_IMG_HTML         Stock spam image part, with distinctive HTML
        1.0 STOCK_IMG_HDR_FROM     Stock spam image part, with distinctive From line


HTML_MESSAGE raised by myself (catching otherwise close to zero spam), but
others were caused by the outlook crap and the image. 8.3 points just for
sending the picture seems to be a bit high.

[18298] dbg: dns: 7.1.3.updates.spamassassin.org => 507739, parsed as 507739
[18298] dbg: channel: current version is 507739, new version is 507739, skipping
channel




------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From jm@jmason.org  2006-12-19 13:47 -------
ah, looks like I forgot to push an update (the sooner we get off the
manually-run 3.1 updates, the better!)

PART_CID_STOCK and PART_CID_STOCK_LESS are additive.  fixed in the new updates...



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From felicity@apache.org  2006-12-19 10:43 -------
fwiw, I'm not surprised by this so much.  the stock image spams were sent using
outlook, so rules targeting them tend to hit outlook mails w/ images in them.

-1.44 ALL_TRUSTED

not relevent.

0.81 EXTRA_MPART_TYPE

there's been discussion about this during rule development.  basically it hits
on any multipart/related mails, because the type= parameter is required.  it has
a score < 1 though, which I would read in as "people writing rules don't get a
lot of multipart/related mails, but it does FP, so the score was set low-ish".

0.00 HTML_MESSAGE

info rule.

0.81 INFO_TLD

this rule was killed.  .info is no longer a useful spam-sign.

2.00 PART_CID_STOCK 
2.00 PART_CID_STOCK_LESS 

These are in Justin's sandbox.  They look similar to my rules, so I'll just talk
about those below...

2.80 TVD_FW_GRAPHIC_ID1 
2.00 TVD_FW_MESG1

These are mine.  ID1 just looks at attachment content-ids, and has a great hit
rate in the nightly run:

 11.858  14.3436   0.0055    1.000   0.99    0.00  T_TVD_FW_GRAPHIC_ID1

but if like the above and these spams are made using outlook, then any other
similar mails will be hit.  I'll tone down the score.

MESG1 targetted some old spam, which according to the nightly results don't
occur anymore:

  0.005   0.0058   0.0000    1.000   0.49    0.00  T_TVD_FW_MESG1

so we should trash that rule.  Basically it looks for something that says it was
forwarded, and also has a GIF image attached.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226


grin@grin.hu changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |grin@grin.hu






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226


felicity@apache.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|Undefined                   |3.1.8






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226


felicity@apache.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|3.1.10                      |3.1.11




------- Additional Comments From felicity@apache.org  2007-07-08 00:34 -------
It appears this is still an issue, but it's fixable via update and so doesn't
need to hold up 3.1.10.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From richard.frovarp@sendit.nodak.edu  2006-12-07 07:40 -------
Created an attachment (id=3771)
 --> (http://issues.apache.org/SpamAssassin/attachment.cgi?id=3771&action=view)
Example of FP message

Example of FP message



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From snifer_@hotmail.com  2006-12-19 12:33 -------
Created an attachment (id=3795)
 --> (http://issues.apache.org/SpamAssassin/attachment.cgi?id=3795&action=view)
FP example

This is a false positive. Critical rules in spam report are:

2.00	PART_CID_STOCK
2.00	PART_CID_STOCK_LESS
2.80	TVD_FW_GRAPHIC_ID1



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From jm@jmason.org  2006-12-19 09:53 -------
please provide as many FP samples as possible -- ensure they are valid RFC-2822
messages though (full headers, not munged by Outlook)



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From snifer_@hotmail.com  2006-12-19 09:42 -------
Same here. Other people are also reporting this in the mailing list (reference:
http://www.nabble.com/HTML-Source-Rule-tf2728267.html#a7705726)



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226


felicity@apache.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|3.1.8                       |3.1.9




------- Additional Comments From felicity@apache.org  2007-01-31 20:00 -------
I lost track on this -- is everything done wrt the updates?  either way, punting
to 3.1.9 since it's more update than release.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226





------- Additional Comments From grin@grin.hu  2007-10-26 12:55 -------
This MAY have been fixed. I believe TVD_FW_GRAPHIC_ID1 was phased out (into
T_TVD_FW_GRAPHIC_ID1 with a completely different scoring) and most of the tests
mentioned seem to have been changed. Hard to verify though.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 5226] FP from 80_additional on OE embedded images

Posted by bu...@bugzilla.spamassassin.org.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5226


felicity@apache.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|3.1.9                       |3.1.10






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.