You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@bugzilla.spamassassin.org on 2005/07/16 20:25:12 UTC

[Bug 4484] New: Rules causing massive FPS in europe/japan

http://bugzilla.spamassassin.org/show_bug.cgi?id=4484

           Summary: Rules causing massive FPS in europe/japan
           Product: Spamassassin
           Version: 3.1.0
          Platform: Other
        OS/Version: other
            Status: NEW
          Severity: major
          Priority: P5
         Component: Rules
        AssignedTo: dev@spamassassin.apache.org
        ReportedBy: mbr@freebsd.org


OBSCURED_EMAIL  Message seems to contain rot13ed address

Many japanese mails are matching here. The FPS rate
is catastrophal. From 40 mails today matching this rule,
15 are HAM. And I can see this from different adresses.

SUBJ_ILLEGAL_CHARS

>From 500 mails today, 82 are definitly not spam. The problem
seems to be that many french mailprogramms, and also german
autogenerated subject contain umlauts and aren't iso-encoded.
This rule may work in the US, but it does definitly not 
work in europe.

These two scores need definitly adjustment.

Martin



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|Rules causing massive FPS in|[review] Rules causing
                   |europe/japan                |massive FPS in europe/japan






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From Bob@Menschel.net  2005-08-06 23:15 -------
-0.2 (since I might be misreading this): 

+# score OBSCURED_EMAIL          0
 
+# Speakers of any language that uses non-English, accented characters may wish
+# to uncomment the following lines.   They turn off rules that fire on
+# misformatted messages generated by common mail apps in contravention of the
+# email RFCs.
+
+# score SUBJ_ILLEGAL_CHARS      0

It would seem to me that OBSCURED_EMAIL should also follow the doc change, no?



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Status Whiteboard|                            |needs 2 votes






------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Status Whiteboard|needs 2 votes               |needs 1 vote




------- Additional Comments From jm@jmason.org  2005-08-08 16:38 -------
imo, no.  we can't imagine all the situations people may want to disable certain
rules -- for example those are in user_prefs, and we already know that many
people don't have per-user preferences set up, some others load them from SQL,
etc.  

Hooking that kind of logic into the install code would be asking for trouble...

btw still needs 1 vote.  (in the "+1" style ;)



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


Bob@Menschel.net changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |triage




------- Additional Comments From Bob@Menschel.net  2005-07-16 19:04 -------
Triage: Martin, are these non-spam hits from Yahoo?  See bug 4352 -- if all (or
almost all) are from Yahoo, then Justin's proposed solution in that bug may be
viable. If these aren't associated with Yahoo, then we need to look at other
options.  Thanks. 



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


duncf@debian.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Severity|major                       |normal
           Keywords|triage                      |
   Target Milestone|Undefined                   |3.1.0




------- Additional Comments From duncf@debian.org  2005-07-23 18:04 -------
Scores are in the process of being adjusted. You're welcome to contribute to the
rescoring process! :-)

Hopefully, these rules will have better scores after the rescore.

http://wiki.apache.org/spamassassin/RescoreDetails



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From jm@jmason.org  2005-08-07 00:29 -------
well, the OBSCURED_EMAIL rule has the same limitations as the rules listed above
it, which already have their own documenting comment.  hence it doesn't need an
extra one.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484


jm@jmason.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED




------- Additional Comments From jm@jmason.org  2005-08-10 17:23 -------
ah, 2 +1s and a "good enough" will have to do under the circumstances.

Sending        rules/user_prefs.template
Transmitting file data .
Committed revision 231360.




------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From jm@jmason.org  2005-08-04 17:32 -------
Created an attachment (id=3053)
 --> (http://bugzilla.spamassassin.org/attachment.cgi?id=3053&action=view)
patch

this patch adds those rules to the list of rules which we suggest
non-english-language users turn off.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From duncf@debian.org  2005-08-06 22:31 -------
Documentation, may not need votes at all.... but +1



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] [review] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From Bob@Menschel.net  2005-08-08 06:39 -------
Good enough for me.  

Thought for 3.2 -- Should there be an install option which automatically
deactivates these rules (perhaps loading these "score 0"s into a new
51_scores.cf file) for sites where any significant number of valid emails are
non-English? Perhaps an option for major families (ie: European emails still
flag Asian languagues and v.v.)? 



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

[Bug 4484] Rules causing massive FPS in europe/japan

Posted by bu...@bugzilla.spamassassin.org.
http://bugzilla.spamassassin.org/show_bug.cgi?id=4484





------- Additional Comments From mbr@freebsd.org  2005-07-17 16:18 -------
(In reply to comment #1)
> Triage: Martin, are these non-spam hits from Yahoo?  See bug 4352 -- if all (or
> almost all) are from Yahoo, then Justin's proposed solution in that bug may be
> viable. If these aren't associated with Yahoo, then we need to look at other
> options.  Thanks. 

No. the OBSCURED_EMAIL hams are from japanese mail-adresses mostly.

The SUBJ_ILLEGAL_CHARS adresses are from mails in germany and french.



------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.