You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by "Daryl C. W. O'Shea" <sp...@dostech.ca> on 2010/02/23 06:29:51 UTC

Automated Rule Updates with Scores Now Functional

FYI... automated score generation and rule update releases for the 3.3
stable branch is now functional (actually, it has been for a week but
there haven't been enough mass-check submissions until now).

The update creation process includes testing of the rule updates on each
targeted version of SpamAssassin (currently 3.3.0 and 3.3.1) to ensure
that the rules will install successfully on each version.

trunk rule updates remain as they have always been.

Daryl

-------- Original Message --------
Subject: svn commit: r915157 - in /spamassassin/trunk/rulesrc/scores:
72_scores.cf scores-set0 scores-set1 scores-set2 scores-set3 stats-set0
stats-set1
Date: Tue, 23 Feb 2010 03:21:54 -0000
From: jm@apache.org
Reply-To: SpamAssassin Dev <de...@spamassassin.apache.org>
To: commits@spamassassin.apache.org

Author: jm
Date: Tue Feb 23 03:21:53 2010
New Revision: 915157

URL: http://svn.apache.org/viewvc?rev=915157&view=rev
Log:
updated scores for revision 912513 active rules added since last mass-check

Modified:
    spamassassin/trunk/rulesrc/scores/72_scores.cf
    spamassassin/trunk/rulesrc/scores/scores-set0
    spamassassin/trunk/rulesrc/scores/scores-set1
    spamassassin/trunk/rulesrc/scores/scores-set2
    spamassassin/trunk/rulesrc/scores/scores-set3
    spamassassin/trunk/rulesrc/scores/stats-set0
    spamassassin/trunk/rulesrc/scores/stats-set1

Modified: spamassassin/trunk/rulesrc/scores/72_scores.cf
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/72_scores.cf?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/72_scores.cf (original)
+++ spamassassin/trunk/rulesrc/scores/72_scores.cf Tue Feb 23 03:21:53 2010
@@ -1,58 +1,41 @@
-score AXB_HELO_HOME_UN                      0.000 0.001 0.000 0.001
-score AXB_URI_APE_ABUSE2                    0.000 2.904 0.000 2.904
-score DATE_IN_FUTURE_Q_PLUS                 0.000 0.001 0.000 0.001
+score AXB_HELO_HOME_UN                      3.899 2.187 3.899 2.187
+score DATE_IN_FUTURE_96_Q                   2.893 0.000 2.893 0.000
+score DATE_IN_FUTURE_Q_PLUS                 0.001 0.000 0.001 0.000
 score DEAR_BENEFICIARY                      2.899 2.799 2.899 2.799
-score DEAR_EMAIL                            0.000 0.001 0.000 0.001
-score DOS_HIGHBIT_HDRS_BODY                 0.000 2.559 0.000 2.559
-score FILL_THIS_FORM                        0.530 0.000 0.530 0.000
-score FORGED_RELAY_MUA_TO_MX                0.000 3.600 0.000 3.600
-score FORGED_TBIRD_IMG_ARROW                0.000 1.560 0.000 1.560
-score FORGED_TBIRD_IMG_SIZE                 0.000 1.166 0.000 1.166
-score FORGED_TBIRD_IMG_TO_MX                0.000 3.319 0.000 3.319
-score FORM_FRAUD                            3.900 0.000 3.900 0.000
-score FROM_MISSPACED                        2.201 0.000 2.201 0.000
-score FROM_MISSP_DYNIP                      1.925 0.001 1.925 0.001
-score FROM_MISSP_FREEMAIL                   1.859 3.399 1.859 3.399
-score FROM_MISSP_MSFT                       3.300 0.001 3.300 0.001
-score FROM_URI                              0.207 2.143 0.207 2.143
-score FROM_WWW                              2.003 2.051 2.003 2.051
-score FRT_ERECTION                          0.000 2.222 0.000 2.222
-score FSL_LSPACES_ABUSE                     0.000 0.001 0.000 0.001
-score FSL_UA                                1.622 0.000 1.622 0.000
-score HDRS_MISSP                            0.000 0.001 0.000 0.001
-score HELO_NO_DOMAIN                        2.320 0.000 2.320 0.000
-score HK_LOTTO_NAME                         0.927 0.000 0.927 0.000
-score HK_NAME_FM_DR                         0.643 0.000 0.643 0.000
-score HK_NAME_FREE                          0.000 2.780 0.000 2.780
-score HK_SCAM_N1                            1.467 0.000 1.467 0.000
-score HK_SCAM_N15                           2.199 0.000 2.199 0.000
-score HK_SCAM_N2                            3.199 1.733 3.199 1.733
-score HK_SCAM_N3                            2.522 0.000 2.522 0.000
-score HK_SCAM_N8                            2.187 0.000 2.187 0.000
-score HK_SCAM_S25                           0.531 0.000 0.531 0.000
-score HK_SPAMMY_FILENAME                    0.511 0.000 0.511 0.000
-score IMG_DIRECT_TO_MX                      0.000 0.001 0.000 0.001
-score KAM_LOTTO3                            0.086 0.000 0.086 0.000
-score KHOP_SC_CIDR16                        0.000 0.001 0.000 0.001
-score KHOP_SC_CIDR24                        0.000 1.426 0.000 1.426
-score KHOP_SC_TOP200                        0.894 3.999 0.894 3.999
-score KHOP_SC_TOP_CIDR16                    0.000 0.001 0.000 0.001
-score KHOP_SC_TOP_CIDR8                     2.700 0.000 2.700 0.000
-score LOTTO_AGENT                           1.448 0.000 1.448 0.000
-score LOTTO_DEPT                            0.936 0.000 0.936 0.000
-score LOTTO_URI                             0.796 0.000 0.796 0.000
-score MANY_GOOG_PROXY                       0.000 0.001 0.000 0.001
-score MANY_SPAN_IN_TEXT                     0.000 1.338 0.000 1.338
-score MONEY_FORM                            1.420 0.000 1.420 0.000
-score MONEY_FROM_MISSP                      1.968 1.063 1.968 1.063
-score MONEY_PERCENT                         2.623 0.000 2.623 0.000
-score OBFU_TEXT_ATTACH                      0.022 0.000 0.022 0.000
-score S25R_1                                0.000 0.000 0.000 0.000
-score S25R_4                                0.000 1.159 0.000 1.159
-score S25R_6                                0.000 3.200 0.000 3.200
-score SANE_75491b468ec2e117e50f9842d32abfab 0.000 0.722 0.000 0.722
-score SANE_b58d7945d89b7afc9e2753c83b00ab44 0.000 1.133 0.000 1.133
-score TAB_IN_FROM                           0.000 0.001 0.000 0.001
-score TO_NO_BRKTS_DYNIP                     0.258 0.001 0.258 0.001
-score TVD_PCT_OFF                           0.000 0.765 0.000 0.765
-score TWO_IPS_RCVD                          1.722 1.499 1.722 1.499
+score DEAR_EMAIL                            0.001 0.000 0.001 0.000
+score DOS_HIGHBIT_HDRS_BODY                 3.799 0.000 3.799 0.000
+score FORGED_RELAY_MUA_TO_MX                3.479 0.000 3.479 0.000
+score FORGED_TBIRD_IMG_ARROW                3.557 0.000 3.557 0.000
+score FORGED_TBIRD_IMG_SIZE                 2.457 0.000 2.457 0.000
+score FORGED_TBIRD_IMG_TO_MX                1.871 0.000 1.871 0.000
+score FROM_MISSP_DYNIP                      2.544 1.333 2.544 1.333
+score FROM_MISSP_FREEMAIL                   3.499 3.500 3.499 3.500
+score FROM_MISSP_MSFT                       3.699 0.001 3.699 0.001
+score FROM_URI                              1.772 0.000 1.772 0.000
+score FROM_WWW                              0.829 0.000 0.829 0.000
+score FR_TITLE_CONS_6                       3.000 0.000 3.000 0.000
+score FSL_LSPACES_ABUSE                     3.551 0.000 3.551 0.000
+score FS_MORE_CONFIDENT                     1.052 0.000 1.052 0.000
+score HELO_NO_DOMAIN                        2.638 0.000 2.638 0.000
+score HK_FAKENAME_MICROSOFT                 2.799 3.600 2.799 3.600
+score HK_NAME_FREE                          2.601 2.537 2.601 2.537
+score HK_RANDOM_FROM                        2.100 0.000 2.100 0.000
+score HK_SCAM_N2                            1.690 3.099 1.690 3.099
+score IMG_DIRECT_TO_MX                      3.999 0.000 3.999 0.000
+score KHOP_SC_CIDR16                        3.637 0.000 3.637 0.000
+score KHOP_SC_CIDR24                        3.359 0.000 3.359 0.000
+score KHOP_SC_TOP200                        3.999 3.999 3.999 3.999
+score KHOP_SC_TOP_CIDR16                    0.001 3.288 0.001 3.288
+score KHOP_SC_TOP_CIDR8                     2.602 0.369 2.602 0.369
+score LOTTO_AGENT                           2.999 2.899 2.999 2.899
+score MANY_GOOG_PROXY                       2.899 0.000 2.899 0.000
+score MANY_SPAN_IN_TEXT                     0.001 2.365 0.001 2.365
+score S25R_1                                0.711 0.000 0.711 0.000
+score S25R_3                                3.799 2.289 3.799 2.289
+score S25R_6                                3.199 0.000 3.199 0.000
+score SANE_75491b468ec2e117e50f9842d32abfab 2.799 0.000 2.799 0.000
+score TAB_IN_FROM                           0.863 3.114 0.863 3.114
+score TINY_FLOAT                            3.799 3.799 3.799 3.799
+score TO_NO_BRKTS_DYNIP                     0.001 0.000 0.001 0.000
+score TVD_PCT_OFF                           2.953 0.000 2.953 0.000
+score TWO_IPS_RCVD                          0.001 0.000 0.001 0.000

Modified: spamassassin/trunk/rulesrc/scores/scores-set0
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set0?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/scores-set0 (original)
+++ spamassassin/trunk/rulesrc/scores/scores-set0 Tue Feb 23 03:21:53 2010
@@ -1,35 +1,44 @@
-# Using score set 0 logs for revision 910179 from:
-# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
spam-bb-doc.log spam-bb-fredt.log spam-bb-guenther_fraud.log
+# Using score set 0 logs for revision 912513 from:
+# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
ham-bb-jhardin.log ham-bb-jhardin_fraud.log ham-bb-jm.log
ham-bb-kmcgrail.log ham-bb-trec_enron.log ham-bb-zmi.log
ham-bernie-it_batt.log ham-bernie-mix.log ham-dos.log ham-jm.log
ham-wt-en1.log ham-wt-en2.log ham-wt-en3.log ham-wt-en4.log
ham-wt-en5.log ham-wt-jp1.log ham-wt-jp2.log spam-bb-doc.log
spam-bb-fredt.log spam-bb-guenther_fraud.log spam-bb-jhardin.log
spam-bb-jhardin_fraud.log spam-bb-jm.log spam-bb-kmcgrail.log
spam-bb-trec_enron.log spam-bb-zmi.log spam-bernie-it_batt.log
spam-bernie-mix.log spam-dos.log spam-jm.log spam-wt-en1.log
spam-wt-en2.log spam-wt-en3.log spam-wt-en4.log spam-wt-en5.log
spam-wt-jp1.log spam-wt-jp2.log

+score AXB_HELO_HOME_UN               3.899
+score DATE_IN_FUTURE_96_Q            2.893
+score DATE_IN_FUTURE_Q_PLUS          0.001
 score DEAR_BENEFICIARY               2.899
-score FILL_THIS_FORM                 0.530
-score FORM_FRAUD                     3.900
-score FROM_MISSPACED                 2.201
-score FROM_MISSP_DYNIP               1.925
-score FROM_MISSP_FREEMAIL            1.859
-score FROM_MISSP_MSFT                3.300
-score FROM_URI                       0.207
-score FROM_WWW                       2.003
-score FSL_UA                         1.622
-score HELO_NO_DOMAIN                 2.320
-score HK_LOTTO_NAME                  0.927
-score HK_NAME_FM_DR                  0.643
-score HK_SCAM_N1                     1.467
-score HK_SCAM_N15                    2.199
-score HK_SCAM_N2                     3.199
-score HK_SCAM_N3                     2.522
-score HK_SCAM_N8                     2.187
-score HK_SCAM_S25                    0.531
-score HK_SPAMMY_FILENAME             0.511
-score KAM_LOTTO3                     0.086
-score KHOP_SC_TOP200                 0.894
-score KHOP_SC_TOP_CIDR8              2.700
-score LOTTO_AGENT                    1.448
-score LOTTO_DEPT                     0.936
-score LOTTO_URI                      0.796
-score MONEY_FORM                     1.420
-score MONEY_FROM_MISSP               1.968
-score MONEY_PERCENT                  2.623
-score OBFU_TEXT_ATTACH               0.022
-score TO_NO_BRKTS_DYNIP              0.258
-score TWO_IPS_RCVD                   1.722
+score DEAR_EMAIL                     0.001
+score DOS_HIGHBIT_HDRS_BODY          3.799
+score FORGED_RELAY_MUA_TO_MX         3.479
+score FORGED_TBIRD_IMG_ARROW         3.557
+score FORGED_TBIRD_IMG_SIZE          2.457
+score FORGED_TBIRD_IMG_TO_MX         1.871
+score FROM_MISSP_DYNIP               2.544
+score FROM_MISSP_FREEMAIL            3.499
+score FROM_MISSP_MSFT                3.699
+score FROM_URI                       1.772
+score FROM_WWW                       0.829
+score FR_TITLE_CONS_6                3.000
+score FSL_LSPACES_ABUSE              3.551
+score FS_MORE_CONFIDENT              1.052
+score HELO_NO_DOMAIN                 2.638
+score HK_FAKENAME_MICROSOFT          2.799
+score HK_NAME_FREE                   2.601
+score HK_RANDOM_FROM                 2.100
+score HK_SCAM_N2                     1.690
+score IMG_DIRECT_TO_MX               3.999
+score KHOP_SC_CIDR16                 3.637
+score KHOP_SC_CIDR24                 3.359
+score KHOP_SC_TOP200                 3.999
+score KHOP_SC_TOP_CIDR16             0.001
+score KHOP_SC_TOP_CIDR8              2.602
+score LOTTO_AGENT                    2.999
+score MANY_GOOG_PROXY                2.899
+score MANY_SPAN_IN_TEXT              0.001
+score S25R_1                         0.711
+score S25R_3                         3.799
+score S25R_6                         3.199
+score SANE_75491b468ec2e117e50f9842d32abfab 2.799
+score TAB_IN_FROM                    0.863
+score TINY_FLOAT                     3.799
+score TO_NO_BRKTS_DYNIP              0.001
+score TVD_PCT_OFF                    2.953
+score TWO_IPS_RCVD                   0.001

Modified: spamassassin/trunk/rulesrc/scores/scores-set1
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set1?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/scores-set1 (original)
+++ spamassassin/trunk/rulesrc/scores/scores-set1 Tue Feb 23 03:21:53 2010
@@ -1,42 +1,20 @@
-# Using score set 1 logs for revision 907194 from:
+# Using score set 1 logs for revision 912093 from:
 # ham-net-bb-doc.log ham-net-bb-fredt.log ham-net-bb-guenther_fraud.log
ham-net-bb-jhardin.log ham-net-bb-jhardin_fraud.log ham-net-bb-jm.log
ham-net-bb-kmcgrail.log ham-net-bb-trec_enron.log ham-net-bb-zmi.log
ham-net-bernie-it_batt.log ham-net-bernie-mix.log ham-net-dos.log
ham-net-jm.log ham-net-kgolding.log ham-net-wt-en1.log
ham-net-wt-en2.log ham-net-wt-en3.log ham-net-wt-en4.log
ham-net-wt-en5.log ham-net-wt-jp1.log ham-net-wt-jp2.log
spam-net-bb-doc.log spam-net-bb-fredt.log spam-net-bb-guenther_fraud.log
spam-net-bb-jhardin.log spam-net-bb-jhardin_fraud.log spam-net-bb-jm.log
spam-net-bb-kmcgrail.log spam-net-bb-trec_enron.log spam-net-bb-zmi.log
spam-net-bernie-it_batt.log spam-net-bernie-mix.log spam-net-dos.log
spam-net-jm.log spam-net-kgolding.log spam-net-wt-en1.log
spam-net-wt-en2.log spam-net-wt-en3.log spam-net-wt-en4.log
spam-net-wt-en5.log spam-net-wt-jp1.log spam-net-wt-jp2.log

-score AXB_HELO_HOME_UN               0.001
-score AXB_URI_APE_ABUSE2             2.904
-score DATE_IN_FUTURE_Q_PLUS          0.001
+score AXB_HELO_HOME_UN               2.187
 score DEAR_BENEFICIARY               2.799
-score DEAR_EMAIL                     0.001
-score DOS_HIGHBIT_HDRS_BODY          2.559
-score FORGED_RELAY_MUA_TO_MX         3.600
-score FORGED_TBIRD_IMG_ARROW         1.560
-score FORGED_TBIRD_IMG_SIZE          1.166
-score FORGED_TBIRD_IMG_TO_MX         3.319
-score FROM_MISSP_DYNIP               0.001
-score FROM_MISSP_FREEMAIL            3.399
+score FORGED_RELAY_MUA_TO_MX         0.000
+score FROM_MISSP_DYNIP               1.333
+score FROM_MISSP_FREEMAIL            3.500
 score FROM_MISSP_MSFT                0.001
-score FROM_URI                       2.143
-score FROM_WWW                       2.051
-score FRT_ERECTION                   2.222
-score FSL_LSPACES_ABUSE              0.001
-score HDRS_MISSP                     0.001
-score HELO_NO_DOMAIN                 0.000
-score HK_NAME_FREE                   2.780
-score HK_SCAM_N2                     1.733
-score IMG_DIRECT_TO_MX               0.001
-score KHOP_SC_CIDR16                 0.001
-score KHOP_SC_CIDR24                 1.426
+score HK_FAKENAME_MICROSOFT          3.600
+score HK_NAME_FREE                   2.537
+score HK_SCAM_N2                     3.099
 score KHOP_SC_TOP200                 3.999
-score KHOP_SC_TOP_CIDR16             0.001
-score KHOP_SC_TOP_CIDR8              0.000
-score MANY_GOOG_PROXY                0.001
-score MANY_SPAN_IN_TEXT              1.338
-score MONEY_FROM_MISSP               1.063
-score S25R_1                         0.000
-score S25R_4                         1.159
-score S25R_6                         3.200
-score SANE_75491b468ec2e117e50f9842d32abfab 0.722
-score SANE_b58d7945d89b7afc9e2753c83b00ab44 1.133
-score TAB_IN_FROM                    0.001
-score TO_NO_BRKTS_DYNIP              0.001
-score TVD_PCT_OFF                    0.765
-score TWO_IPS_RCVD                   1.499
+score KHOP_SC_TOP_CIDR16             3.288
+score KHOP_SC_TOP_CIDR8              0.369
+score LOTTO_AGENT                    2.899
+score MANY_SPAN_IN_TEXT              2.365
+score S25R_3                         2.289
+score TAB_IN_FROM                    3.114
+score TINY_FLOAT                     3.799

Modified: spamassassin/trunk/rulesrc/scores/scores-set2
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set2?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/scores-set2 (original)
+++ spamassassin/trunk/rulesrc/scores/scores-set2 Tue Feb 23 03:21:53 2010
@@ -1,35 +1,44 @@
-# Using score set 0 logs for revision 910179 from:
-# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
spam-bb-doc.log spam-bb-fredt.log spam-bb-guenther_fraud.log
+# Using score set 0 logs for revision 912513 from:
+# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
ham-bb-jhardin.log ham-bb-jhardin_fraud.log ham-bb-jm.log
ham-bb-kmcgrail.log ham-bb-trec_enron.log ham-bb-zmi.log
ham-bernie-it_batt.log ham-bernie-mix.log ham-dos.log ham-jm.log
ham-wt-en1.log ham-wt-en2.log ham-wt-en3.log ham-wt-en4.log
ham-wt-en5.log ham-wt-jp1.log ham-wt-jp2.log spam-bb-doc.log
spam-bb-fredt.log spam-bb-guenther_fraud.log spam-bb-jhardin.log
spam-bb-jhardin_fraud.log spam-bb-jm.log spam-bb-kmcgrail.log
spam-bb-trec_enron.log spam-bb-zmi.log spam-bernie-it_batt.log
spam-bernie-mix.log spam-dos.log spam-jm.log spam-wt-en1.log
spam-wt-en2.log spam-wt-en3.log spam-wt-en4.log spam-wt-en5.log
spam-wt-jp1.log spam-wt-jp2.log

+score AXB_HELO_HOME_UN               3.899
+score DATE_IN_FUTURE_96_Q            2.893
+score DATE_IN_FUTURE_Q_PLUS          0.001
 score DEAR_BENEFICIARY               2.899
-score FILL_THIS_FORM                 0.530
-score FORM_FRAUD                     3.900
-score FROM_MISSPACED                 2.201
-score FROM_MISSP_DYNIP               1.925
-score FROM_MISSP_FREEMAIL            1.859
-score FROM_MISSP_MSFT                3.300
-score FROM_URI                       0.207
-score FROM_WWW                       2.003
-score FSL_UA                         1.622
-score HELO_NO_DOMAIN                 2.320
-score HK_LOTTO_NAME                  0.927
-score HK_NAME_FM_DR                  0.643
-score HK_SCAM_N1                     1.467
-score HK_SCAM_N15                    2.199
-score HK_SCAM_N2                     3.199
-score HK_SCAM_N3                     2.522
-score HK_SCAM_N8                     2.187
-score HK_SCAM_S25                    0.531
-score HK_SPAMMY_FILENAME             0.511
-score KAM_LOTTO3                     0.086
-score KHOP_SC_TOP200                 0.894
-score KHOP_SC_TOP_CIDR8              2.700
-score LOTTO_AGENT                    1.448
-score LOTTO_DEPT                     0.936
-score LOTTO_URI                      0.796
-score MONEY_FORM                     1.420
-score MONEY_FROM_MISSP               1.968
-score MONEY_PERCENT                  2.623
-score OBFU_TEXT_ATTACH               0.022
-score TO_NO_BRKTS_DYNIP              0.258
-score TWO_IPS_RCVD                   1.722
+score DEAR_EMAIL                     0.001
+score DOS_HIGHBIT_HDRS_BODY          3.799
+score FORGED_RELAY_MUA_TO_MX         3.479
+score FORGED_TBIRD_IMG_ARROW         3.557
+score FORGED_TBIRD_IMG_SIZE          2.457
+score FORGED_TBIRD_IMG_TO_MX         1.871
+score FROM_MISSP_DYNIP               2.544
+score FROM_MISSP_FREEMAIL            3.499
+score FROM_MISSP_MSFT                3.699
+score FROM_URI                       1.772
+score FROM_WWW                       0.829
+score FR_TITLE_CONS_6                3.000
+score FSL_LSPACES_ABUSE              3.551
+score FS_MORE_CONFIDENT              1.052
+score HELO_NO_DOMAIN                 2.638
+score HK_FAKENAME_MICROSOFT          2.799
+score HK_NAME_FREE                   2.601
+score HK_RANDOM_FROM                 2.100
+score HK_SCAM_N2                     1.690
+score IMG_DIRECT_TO_MX               3.999
+score KHOP_SC_CIDR16                 3.637
+score KHOP_SC_CIDR24                 3.359
+score KHOP_SC_TOP200                 3.999
+score KHOP_SC_TOP_CIDR16             0.001
+score KHOP_SC_TOP_CIDR8              2.602
+score LOTTO_AGENT                    2.999
+score MANY_GOOG_PROXY                2.899
+score MANY_SPAN_IN_TEXT              0.001
+score S25R_1                         0.711
+score S25R_3                         3.799
+score S25R_6                         3.199
+score SANE_75491b468ec2e117e50f9842d32abfab 2.799
+score TAB_IN_FROM                    0.863
+score TINY_FLOAT                     3.799
+score TO_NO_BRKTS_DYNIP              0.001
+score TVD_PCT_OFF                    2.953
+score TWO_IPS_RCVD                   0.001

Modified: spamassassin/trunk/rulesrc/scores/scores-set3
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set3?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/scores-set3 (original)
+++ spamassassin/trunk/rulesrc/scores/scores-set3 Tue Feb 23 03:21:53 2010
@@ -1,42 +1,20 @@
-# Using score set 1 logs for revision 907194 from:
+# Using score set 1 logs for revision 912093 from:
 # ham-net-bb-doc.log ham-net-bb-fredt.log ham-net-bb-guenther_fraud.log
ham-net-bb-jhardin.log ham-net-bb-jhardin_fraud.log ham-net-bb-jm.log
ham-net-bb-kmcgrail.log ham-net-bb-trec_enron.log ham-net-bb-zmi.log
ham-net-bernie-it_batt.log ham-net-bernie-mix.log ham-net-dos.log
ham-net-jm.log ham-net-kgolding.log ham-net-wt-en1.log
ham-net-wt-en2.log ham-net-wt-en3.log ham-net-wt-en4.log
ham-net-wt-en5.log ham-net-wt-jp1.log ham-net-wt-jp2.log
spam-net-bb-doc.log spam-net-bb-fredt.log spam-net-bb-guenther_fraud.log
spam-net-bb-jhardin.log spam-net-bb-jhardin_fraud.log spam-net-bb-jm.log
spam-net-bb-kmcgrail.log spam-net-bb-trec_enron.log spam-net-bb-zmi.log
spam-net-bernie-it_batt.log spam-net-bernie-mix.log spam-net-dos.log
spam-net-jm.log spam-net-kgolding.log spam-net-wt-en1.log
spam-net-wt-en2.log spam-net-wt-en3.log spam-net-wt-en4.log
spam-net-wt-en5.log spam-net-wt-jp1.log spam-net-wt-jp2.log

-score AXB_HELO_HOME_UN               0.001
-score AXB_URI_APE_ABUSE2             2.904
-score DATE_IN_FUTURE_Q_PLUS          0.001
+score AXB_HELO_HOME_UN               2.187
 score DEAR_BENEFICIARY               2.799
-score DEAR_EMAIL                     0.001
-score DOS_HIGHBIT_HDRS_BODY          2.559
-score FORGED_RELAY_MUA_TO_MX         3.600
-score FORGED_TBIRD_IMG_ARROW         1.560
-score FORGED_TBIRD_IMG_SIZE          1.166
-score FORGED_TBIRD_IMG_TO_MX         3.319
-score FROM_MISSP_DYNIP               0.001
-score FROM_MISSP_FREEMAIL            3.399
+score FORGED_RELAY_MUA_TO_MX         0.000
+score FROM_MISSP_DYNIP               1.333
+score FROM_MISSP_FREEMAIL            3.500
 score FROM_MISSP_MSFT                0.001
-score FROM_URI                       2.143
-score FROM_WWW                       2.051
-score FRT_ERECTION                   2.222
-score FSL_LSPACES_ABUSE              0.001
-score HDRS_MISSP                     0.001
-score HELO_NO_DOMAIN                 0.000
-score HK_NAME_FREE                   2.780
-score HK_SCAM_N2                     1.733
-score IMG_DIRECT_TO_MX               0.001
-score KHOP_SC_CIDR16                 0.001
-score KHOP_SC_CIDR24                 1.426
+score HK_FAKENAME_MICROSOFT          3.600
+score HK_NAME_FREE                   2.537
+score HK_SCAM_N2                     3.099
 score KHOP_SC_TOP200                 3.999
-score KHOP_SC_TOP_CIDR16             0.001
-score KHOP_SC_TOP_CIDR8              0.000
-score MANY_GOOG_PROXY                0.001
-score MANY_SPAN_IN_TEXT              1.338
-score MONEY_FROM_MISSP               1.063
-score S25R_1                         0.000
-score S25R_4                         1.159
-score S25R_6                         3.200
-score SANE_75491b468ec2e117e50f9842d32abfab 0.722
-score SANE_b58d7945d89b7afc9e2753c83b00ab44 1.133
-score TAB_IN_FROM                    0.001
-score TO_NO_BRKTS_DYNIP              0.001
-score TVD_PCT_OFF                    0.765
-score TWO_IPS_RCVD                   1.499
+score KHOP_SC_TOP_CIDR16             3.288
+score KHOP_SC_TOP_CIDR8              0.369
+score LOTTO_AGENT                    2.899
+score MANY_SPAN_IN_TEXT              2.365
+score S25R_3                         2.289
+score TAB_IN_FROM                    3.114
+score TINY_FLOAT                     3.799

Modified: spamassassin/trunk/rulesrc/scores/stats-set0
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/stats-set0?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/stats-set0 (original)
+++ spamassassin/trunk/rulesrc/scores/stats-set0 Tue Feb 23 03:21:53 2010
@@ -1,32 +1,40 @@
 ##### WITH NEW RULES AND SCORES #####

 # SUMMARY for threshold 5.0:
-# Correctly non-spam:      2  0.336%  (100.000% of non-spam corpus)
-# Correctly spam:        555  93.121%  (93.434% of spam corpus)
-# False positives:         0  0.000%  (0.000% of nonspam,      0 weighted)
-# False negatives:        39  6.544%  (6.566% of spam,     92 weighted)
-# Average score for spam:  24.6    nonspam: 2.8
-# Average for false-pos:   -NaN  false-neg: 2.4
-# TOTAL:                 596  100.00%
+# Correctly non-spam: 130247  12.143%  (98.572% of non-spam corpus)
+# Correctly spam:     899718  83.884%  (95.670% of spam corpus)
+# False positives:      1887  0.176%  (1.428% of nonspam, 435137 weighted)
+# False negatives:     40724  3.797%  (4.330% of spam,  93995 weighted)
+# Average score for spam:  14.7    nonspam: 0.4
+# Average for false-pos:   6.5  false-neg: 2.3
+# TOTAL:              1072576  100.00%

 Reading scores from "tmprules"...
+Reading per-message hit stat logs and scores...
+
+# SUMMARY for threshold 5.0:
+# Correctly non-spam:  16339  98.55%
+# Correctly spam:     112412  95.74%
+# False positives:       241  1.45%
+# False negatives:      5007  4.26%
+# TCR(l=50): 6.883919  SpamRecall: 95.736%  SpamPrec: 99.786%

 ##### WITHOUT NEW RULES AND SCORES #####
 Reading scores from "../rules-base"...
 Reading per-message hit stat logs and scores...

 # SUMMARY for threshold 5.0:
-# Correctly non-spam:      2  100.00%
-# Correctly spam:        436  73.40%
-# False positives:         0  0.00%
-# False negatives:       158  26.60%
-# TCR(l=50): 3.759494  SpamRecall: 73.401%  SpamPrec: 100.000%
+# Correctly non-spam: 130473  98.74%
+# Correctly spam:     641489  68.21%
+# False positives:      1661  1.26%
+# False negatives:    298953  31.79%
+# TCR(l=50): 2.461871  SpamRecall: 68.211%  SpamPrec: 99.742%
 Reading scores from "../rules-base"...
 Reading per-message hit stat logs and scores...

 # SUMMARY for threshold 5.0:
-# Correctly non-spam:      1  100.00%
-# Correctly spam:         49  75.38%
-# False positives:         0  0.00%
-# False negatives:        16  24.62%
-# TCR(l=50): 4.062500  SpamRecall: 75.385%  SpamPrec: 100.000%
+# Correctly non-spam:  16390  98.85%
+# Correctly spam:      80029  68.16%
+# False positives:       190  1.15%
+# False negatives:     37390  31.84%
+# TCR(l=50): 2.504137  SpamRecall: 68.157%  SpamPrec: 99.763%

Modified: spamassassin/trunk/rulesrc/scores/stats-set1
URL:
http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/stats-set1?rev=915157&r1=915156&r2=915157&view=diff
==============================================================================
--- spamassassin/trunk/rulesrc/scores/stats-set1 (original)
+++ spamassassin/trunk/rulesrc/scores/stats-set1 Tue Feb 23 03:21:53 2010
@@ -1,40 +1,40 @@
 ##### WITH NEW RULES AND SCORES #####

 # SUMMARY for threshold 5.0:
-# Correctly non-spam: 132400  13.291%  (98.974% of non-spam corpus)
-# Correctly spam:     855253  85.852%  (99.169% of spam corpus)
-# False positives:      1372  0.138%  (1.026% of nonspam, 1574316 weighted)
-# False negatives:      7171  0.720%  (0.831% of spam,  19669 weighted)
-# Average score for spam:  23.1    nonspam: -0.9
-# Average for false-pos:   17.8  false-neg: 2.7
-# TOTAL:              996196  100.00%
+# Correctly non-spam: 132947  12.408%  (99.725% of non-spam corpus)
+# Correctly spam:     930734  86.864%  (99.207% of spam corpus)
+# False positives:       367  0.034%  (0.275% of nonspam, 154836 weighted)
+# False negatives:      7437  0.694%  (0.793% of spam,  21854 weighted)
+# Average score for spam:  23.0    nonspam: -1.1
+# Average for false-pos:   6.0  false-neg: 2.9
+# TOTAL:              1071485  100.00%

 Reading scores from "tmprules"...
 Reading per-message hit stat logs and scores...

 # SUMMARY for threshold 5.0:
-# Correctly non-spam:  16585  98.93%
-# Correctly spam:     106696  99.15%
-# False positives:       180  1.07%
-# False negatives:       917  0.85%
-# TCR(l=50): 10.851366  SpamRecall: 99.148%  SpamPrec: 99.832%
+# Correctly non-spam:  16653  99.70%
+# Correctly spam:     116258  99.28%
+# False positives:        50  0.30%
+# False negatives:       841  0.72%
+# TCR(l=50): 35.049087  SpamRecall: 99.282%  SpamPrec: 99.957%

 ##### WITHOUT NEW RULES AND SCORES #####
 Reading scores from "../rules-base"...
 Reading per-message hit stat logs and scores...

 # SUMMARY for threshold 5.0:
-# Correctly non-spam: 132307  98.90%
-# Correctly spam:     839199  97.31%
-# False positives:      1465  1.10%
-# False negatives:     23225  2.69%
-# TCR(l=50): 8.939352  SpamRecall: 97.307%  SpamPrec: 99.826%
+# Correctly non-spam: 132853  99.65%
+# Correctly spam:     914814  97.51%
+# False positives:       461  0.35%
+# False negatives:     23357  2.49%
+# TCR(l=50): 20.216153  SpamRecall: 97.510%  SpamPrec: 99.950%
 Reading scores from "../rules-base"...
 Reading per-message hit stat logs and scores...

 # SUMMARY for threshold 5.0:
-# Correctly non-spam:  16575  98.87%
-# Correctly spam:     104639  97.24%
-# False positives:       190  1.13%
-# False negatives:      2974  2.76%
-# TCR(l=50): 8.626984  SpamRecall: 97.236%  SpamPrec: 99.819%
+# Correctly non-spam:  16638  99.61%
+# Correctly spam:     114267  97.58%
+# False positives:        65  0.39%
+# False negatives:      2832  2.42%
+# TCR(l=50): 19.253371  SpamRecall: 97.582%  SpamPrec: 99.943%




Re: Automated Rule Updates with Scores Now Functional

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
Excellent!

On 2/23/2010 12:29 AM, Daryl C. W. O'Shea wrote:
> FYI... automated score generation and rule update releases for the 3.3
> stable branch is now functional (actually, it has been for a week but
> there haven't been enough mass-check submissions until now).
>
> The update creation process includes testing of the rule updates on each
> targeted version of SpamAssassin (currently 3.3.0 and 3.3.1) to ensure
> that the rules will install successfully on each version.
>
> trunk rule updates remain as they have always been.
>
> Daryl
>
> -------- Original Message --------
> Subject: svn commit: r915157 - in /spamassassin/trunk/rulesrc/scores:
> 72_scores.cf scores-set0 scores-set1 scores-set2 scores-set3 stats-set0
> stats-set1
> Date: Tue, 23 Feb 2010 03:21:54 -0000
> From: jm@apache.org
> Reply-To: SpamAssassin Dev<de...@spamassassin.apache.org>
> To: commits@spamassassin.apache.org
>
> Author: jm
> Date: Tue Feb 23 03:21:53 2010
> New Revision: 915157
>
> URL: http://svn.apache.org/viewvc?rev=915157&view=rev
> Log:
> updated scores for revision 912513 active rules added since last mass-check
>
> Modified:
>      spamassassin/trunk/rulesrc/scores/72_scores.cf
>      spamassassin/trunk/rulesrc/scores/scores-set0
>      spamassassin/trunk/rulesrc/scores/scores-set1
>      spamassassin/trunk/rulesrc/scores/scores-set2
>      spamassassin/trunk/rulesrc/scores/scores-set3
>      spamassassin/trunk/rulesrc/scores/stats-set0
>      spamassassin/trunk/rulesrc/scores/stats-set1
>
> Modified: spamassassin/trunk/rulesrc/scores/72_scores.cf
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/72_scores.cf?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/72_scores.cf (original)
> +++ spamassassin/trunk/rulesrc/scores/72_scores.cf Tue Feb 23 03:21:53 2010
> @@ -1,58 +1,41 @@
> -score AXB_HELO_HOME_UN                      0.000 0.001 0.000 0.001
> -score AXB_URI_APE_ABUSE2                    0.000 2.904 0.000 2.904
> -score DATE_IN_FUTURE_Q_PLUS                 0.000 0.001 0.000 0.001
> +score AXB_HELO_HOME_UN                      3.899 2.187 3.899 2.187
> +score DATE_IN_FUTURE_96_Q                   2.893 0.000 2.893 0.000
> +score DATE_IN_FUTURE_Q_PLUS                 0.001 0.000 0.001 0.000
>   score DEAR_BENEFICIARY                      2.899 2.799 2.899 2.799
> -score DEAR_EMAIL                            0.000 0.001 0.000 0.001
> -score DOS_HIGHBIT_HDRS_BODY                 0.000 2.559 0.000 2.559
> -score FILL_THIS_FORM                        0.530 0.000 0.530 0.000
> -score FORGED_RELAY_MUA_TO_MX                0.000 3.600 0.000 3.600
> -score FORGED_TBIRD_IMG_ARROW                0.000 1.560 0.000 1.560
> -score FORGED_TBIRD_IMG_SIZE                 0.000 1.166 0.000 1.166
> -score FORGED_TBIRD_IMG_TO_MX                0.000 3.319 0.000 3.319
> -score FORM_FRAUD                            3.900 0.000 3.900 0.000
> -score FROM_MISSPACED                        2.201 0.000 2.201 0.000
> -score FROM_MISSP_DYNIP                      1.925 0.001 1.925 0.001
> -score FROM_MISSP_FREEMAIL                   1.859 3.399 1.859 3.399
> -score FROM_MISSP_MSFT                       3.300 0.001 3.300 0.001
> -score FROM_URI                              0.207 2.143 0.207 2.143
> -score FROM_WWW                              2.003 2.051 2.003 2.051
> -score FRT_ERECTION                          0.000 2.222 0.000 2.222
> -score FSL_LSPACES_ABUSE                     0.000 0.001 0.000 0.001
> -score FSL_UA                                1.622 0.000 1.622 0.000
> -score HDRS_MISSP                            0.000 0.001 0.000 0.001
> -score HELO_NO_DOMAIN                        2.320 0.000 2.320 0.000
> -score HK_LOTTO_NAME                         0.927 0.000 0.927 0.000
> -score HK_NAME_FM_DR                         0.643 0.000 0.643 0.000
> -score HK_NAME_FREE                          0.000 2.780 0.000 2.780
> -score HK_SCAM_N1                            1.467 0.000 1.467 0.000
> -score HK_SCAM_N15                           2.199 0.000 2.199 0.000
> -score HK_SCAM_N2                            3.199 1.733 3.199 1.733
> -score HK_SCAM_N3                            2.522 0.000 2.522 0.000
> -score HK_SCAM_N8                            2.187 0.000 2.187 0.000
> -score HK_SCAM_S25                           0.531 0.000 0.531 0.000
> -score HK_SPAMMY_FILENAME                    0.511 0.000 0.511 0.000
> -score IMG_DIRECT_TO_MX                      0.000 0.001 0.000 0.001
> -score KAM_LOTTO3                            0.086 0.000 0.086 0.000
> -score KHOP_SC_CIDR16                        0.000 0.001 0.000 0.001
> -score KHOP_SC_CIDR24                        0.000 1.426 0.000 1.426
> -score KHOP_SC_TOP200                        0.894 3.999 0.894 3.999
> -score KHOP_SC_TOP_CIDR16                    0.000 0.001 0.000 0.001
> -score KHOP_SC_TOP_CIDR8                     2.700 0.000 2.700 0.000
> -score LOTTO_AGENT                           1.448 0.000 1.448 0.000
> -score LOTTO_DEPT                            0.936 0.000 0.936 0.000
> -score LOTTO_URI                             0.796 0.000 0.796 0.000
> -score MANY_GOOG_PROXY                       0.000 0.001 0.000 0.001
> -score MANY_SPAN_IN_TEXT                     0.000 1.338 0.000 1.338
> -score MONEY_FORM                            1.420 0.000 1.420 0.000
> -score MONEY_FROM_MISSP                      1.968 1.063 1.968 1.063
> -score MONEY_PERCENT                         2.623 0.000 2.623 0.000
> -score OBFU_TEXT_ATTACH                      0.022 0.000 0.022 0.000
> -score S25R_1                                0.000 0.000 0.000 0.000
> -score S25R_4                                0.000 1.159 0.000 1.159
> -score S25R_6                                0.000 3.200 0.000 3.200
> -score SANE_75491b468ec2e117e50f9842d32abfab 0.000 0.722 0.000 0.722
> -score SANE_b58d7945d89b7afc9e2753c83b00ab44 0.000 1.133 0.000 1.133
> -score TAB_IN_FROM                           0.000 0.001 0.000 0.001
> -score TO_NO_BRKTS_DYNIP                     0.258 0.001 0.258 0.001
> -score TVD_PCT_OFF                           0.000 0.765 0.000 0.765
> -score TWO_IPS_RCVD                          1.722 1.499 1.722 1.499
> +score DEAR_EMAIL                            0.001 0.000 0.001 0.000
> +score DOS_HIGHBIT_HDRS_BODY                 3.799 0.000 3.799 0.000
> +score FORGED_RELAY_MUA_TO_MX                3.479 0.000 3.479 0.000
> +score FORGED_TBIRD_IMG_ARROW                3.557 0.000 3.557 0.000
> +score FORGED_TBIRD_IMG_SIZE                 2.457 0.000 2.457 0.000
> +score FORGED_TBIRD_IMG_TO_MX                1.871 0.000 1.871 0.000
> +score FROM_MISSP_DYNIP                      2.544 1.333 2.544 1.333
> +score FROM_MISSP_FREEMAIL                   3.499 3.500 3.499 3.500
> +score FROM_MISSP_MSFT                       3.699 0.001 3.699 0.001
> +score FROM_URI                              1.772 0.000 1.772 0.000
> +score FROM_WWW                              0.829 0.000 0.829 0.000
> +score FR_TITLE_CONS_6                       3.000 0.000 3.000 0.000
> +score FSL_LSPACES_ABUSE                     3.551 0.000 3.551 0.000
> +score FS_MORE_CONFIDENT                     1.052 0.000 1.052 0.000
> +score HELO_NO_DOMAIN                        2.638 0.000 2.638 0.000
> +score HK_FAKENAME_MICROSOFT                 2.799 3.600 2.799 3.600
> +score HK_NAME_FREE                          2.601 2.537 2.601 2.537
> +score HK_RANDOM_FROM                        2.100 0.000 2.100 0.000
> +score HK_SCAM_N2                            1.690 3.099 1.690 3.099
> +score IMG_DIRECT_TO_MX                      3.999 0.000 3.999 0.000
> +score KHOP_SC_CIDR16                        3.637 0.000 3.637 0.000
> +score KHOP_SC_CIDR24                        3.359 0.000 3.359 0.000
> +score KHOP_SC_TOP200                        3.999 3.999 3.999 3.999
> +score KHOP_SC_TOP_CIDR16                    0.001 3.288 0.001 3.288
> +score KHOP_SC_TOP_CIDR8                     2.602 0.369 2.602 0.369
> +score LOTTO_AGENT                           2.999 2.899 2.999 2.899
> +score MANY_GOOG_PROXY                       2.899 0.000 2.899 0.000
> +score MANY_SPAN_IN_TEXT                     0.001 2.365 0.001 2.365
> +score S25R_1                                0.711 0.000 0.711 0.000
> +score S25R_3                                3.799 2.289 3.799 2.289
> +score S25R_6                                3.199 0.000 3.199 0.000
> +score SANE_75491b468ec2e117e50f9842d32abfab 2.799 0.000 2.799 0.000
> +score TAB_IN_FROM                           0.863 3.114 0.863 3.114
> +score TINY_FLOAT                            3.799 3.799 3.799 3.799
> +score TO_NO_BRKTS_DYNIP                     0.001 0.000 0.001 0.000
> +score TVD_PCT_OFF                           2.953 0.000 2.953 0.000
> +score TWO_IPS_RCVD                          0.001 0.000 0.001 0.000
>
> Modified: spamassassin/trunk/rulesrc/scores/scores-set0
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set0?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/scores-set0 (original)
> +++ spamassassin/trunk/rulesrc/scores/scores-set0 Tue Feb 23 03:21:53 2010
> @@ -1,35 +1,44 @@
> -# Using score set 0 logs for revision 910179 from:
> -# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
> spam-bb-doc.log spam-bb-fredt.log spam-bb-guenther_fraud.log
> +# Using score set 0 logs for revision 912513 from:
> +# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
> ham-bb-jhardin.log ham-bb-jhardin_fraud.log ham-bb-jm.log
> ham-bb-kmcgrail.log ham-bb-trec_enron.log ham-bb-zmi.log
> ham-bernie-it_batt.log ham-bernie-mix.log ham-dos.log ham-jm.log
> ham-wt-en1.log ham-wt-en2.log ham-wt-en3.log ham-wt-en4.log
> ham-wt-en5.log ham-wt-jp1.log ham-wt-jp2.log spam-bb-doc.log
> spam-bb-fredt.log spam-bb-guenther_fraud.log spam-bb-jhardin.log
> spam-bb-jhardin_fraud.log spam-bb-jm.log spam-bb-kmcgrail.log
> spam-bb-trec_enron.log spam-bb-zmi.log spam-bernie-it_batt.log
> spam-bernie-mix.log spam-dos.log spam-jm.log spam-wt-en1.log
> spam-wt-en2.log spam-wt-en3.log spam-wt-en4.log spam-wt-en5.log
> spam-wt-jp1.log spam-wt-jp2.log
>
> +score AXB_HELO_HOME_UN               3.899
> +score DATE_IN_FUTURE_96_Q            2.893
> +score DATE_IN_FUTURE_Q_PLUS          0.001
>   score DEAR_BENEFICIARY               2.899
> -score FILL_THIS_FORM                 0.530
> -score FORM_FRAUD                     3.900
> -score FROM_MISSPACED                 2.201
> -score FROM_MISSP_DYNIP               1.925
> -score FROM_MISSP_FREEMAIL            1.859
> -score FROM_MISSP_MSFT                3.300
> -score FROM_URI                       0.207
> -score FROM_WWW                       2.003
> -score FSL_UA                         1.622
> -score HELO_NO_DOMAIN                 2.320
> -score HK_LOTTO_NAME                  0.927
> -score HK_NAME_FM_DR                  0.643
> -score HK_SCAM_N1                     1.467
> -score HK_SCAM_N15                    2.199
> -score HK_SCAM_N2                     3.199
> -score HK_SCAM_N3                     2.522
> -score HK_SCAM_N8                     2.187
> -score HK_SCAM_S25                    0.531
> -score HK_SPAMMY_FILENAME             0.511
> -score KAM_LOTTO3                     0.086
> -score KHOP_SC_TOP200                 0.894
> -score KHOP_SC_TOP_CIDR8              2.700
> -score LOTTO_AGENT                    1.448
> -score LOTTO_DEPT                     0.936
> -score LOTTO_URI                      0.796
> -score MONEY_FORM                     1.420
> -score MONEY_FROM_MISSP               1.968
> -score MONEY_PERCENT                  2.623
> -score OBFU_TEXT_ATTACH               0.022
> -score TO_NO_BRKTS_DYNIP              0.258
> -score TWO_IPS_RCVD                   1.722
> +score DEAR_EMAIL                     0.001
> +score DOS_HIGHBIT_HDRS_BODY          3.799
> +score FORGED_RELAY_MUA_TO_MX         3.479
> +score FORGED_TBIRD_IMG_ARROW         3.557
> +score FORGED_TBIRD_IMG_SIZE          2.457
> +score FORGED_TBIRD_IMG_TO_MX         1.871
> +score FROM_MISSP_DYNIP               2.544
> +score FROM_MISSP_FREEMAIL            3.499
> +score FROM_MISSP_MSFT                3.699
> +score FROM_URI                       1.772
> +score FROM_WWW                       0.829
> +score FR_TITLE_CONS_6                3.000
> +score FSL_LSPACES_ABUSE              3.551
> +score FS_MORE_CONFIDENT              1.052
> +score HELO_NO_DOMAIN                 2.638
> +score HK_FAKENAME_MICROSOFT          2.799
> +score HK_NAME_FREE                   2.601
> +score HK_RANDOM_FROM                 2.100
> +score HK_SCAM_N2                     1.690
> +score IMG_DIRECT_TO_MX               3.999
> +score KHOP_SC_CIDR16                 3.637
> +score KHOP_SC_CIDR24                 3.359
> +score KHOP_SC_TOP200                 3.999
> +score KHOP_SC_TOP_CIDR16             0.001
> +score KHOP_SC_TOP_CIDR8              2.602
> +score LOTTO_AGENT                    2.999
> +score MANY_GOOG_PROXY                2.899
> +score MANY_SPAN_IN_TEXT              0.001
> +score S25R_1                         0.711
> +score S25R_3                         3.799
> +score S25R_6                         3.199
> +score SANE_75491b468ec2e117e50f9842d32abfab 2.799
> +score TAB_IN_FROM                    0.863
> +score TINY_FLOAT                     3.799
> +score TO_NO_BRKTS_DYNIP              0.001
> +score TVD_PCT_OFF                    2.953
> +score TWO_IPS_RCVD                   0.001
>
> Modified: spamassassin/trunk/rulesrc/scores/scores-set1
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set1?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/scores-set1 (original)
> +++ spamassassin/trunk/rulesrc/scores/scores-set1 Tue Feb 23 03:21:53 2010
> @@ -1,42 +1,20 @@
> -# Using score set 1 logs for revision 907194 from:
> +# Using score set 1 logs for revision 912093 from:
>   # ham-net-bb-doc.log ham-net-bb-fredt.log ham-net-bb-guenther_fraud.log
> ham-net-bb-jhardin.log ham-net-bb-jhardin_fraud.log ham-net-bb-jm.log
> ham-net-bb-kmcgrail.log ham-net-bb-trec_enron.log ham-net-bb-zmi.log
> ham-net-bernie-it_batt.log ham-net-bernie-mix.log ham-net-dos.log
> ham-net-jm.log ham-net-kgolding.log ham-net-wt-en1.log
> ham-net-wt-en2.log ham-net-wt-en3.log ham-net-wt-en4.log
> ham-net-wt-en5.log ham-net-wt-jp1.log ham-net-wt-jp2.log
> spam-net-bb-doc.log spam-net-bb-fredt.log spam-net-bb-guenther_fraud.log
> spam-net-bb-jhardin.log spam-net-bb-jhardin_fraud.log spam-net-bb-jm.log
> spam-net-bb-kmcgrail.log spam-net-bb-trec_enron.log spam-net-bb-zmi.log
> spam-net-bernie-it_batt.log spam-net-bernie-mix.log spam-net-dos.log
> spam-net-jm.log spam-net-kgolding.log spam-net-wt-en1.log
> spam-net-wt-en2.log spam-net-wt-en3.log spam-net-wt-en4.log
> spam-net-wt-en5.log spam-net-wt-jp1.log spam-net-wt-jp2.log
>
> -score AXB_HELO_HOME_UN               0.001
> -score AXB_URI_APE_ABUSE2             2.904
> -score DATE_IN_FUTURE_Q_PLUS          0.001
> +score AXB_HELO_HOME_UN               2.187
>   score DEAR_BENEFICIARY               2.799
> -score DEAR_EMAIL                     0.001
> -score DOS_HIGHBIT_HDRS_BODY          2.559
> -score FORGED_RELAY_MUA_TO_MX         3.600
> -score FORGED_TBIRD_IMG_ARROW         1.560
> -score FORGED_TBIRD_IMG_SIZE          1.166
> -score FORGED_TBIRD_IMG_TO_MX         3.319
> -score FROM_MISSP_DYNIP               0.001
> -score FROM_MISSP_FREEMAIL            3.399
> +score FORGED_RELAY_MUA_TO_MX         0.000
> +score FROM_MISSP_DYNIP               1.333
> +score FROM_MISSP_FREEMAIL            3.500
>   score FROM_MISSP_MSFT                0.001
> -score FROM_URI                       2.143
> -score FROM_WWW                       2.051
> -score FRT_ERECTION                   2.222
> -score FSL_LSPACES_ABUSE              0.001
> -score HDRS_MISSP                     0.001
> -score HELO_NO_DOMAIN                 0.000
> -score HK_NAME_FREE                   2.780
> -score HK_SCAM_N2                     1.733
> -score IMG_DIRECT_TO_MX               0.001
> -score KHOP_SC_CIDR16                 0.001
> -score KHOP_SC_CIDR24                 1.426
> +score HK_FAKENAME_MICROSOFT          3.600
> +score HK_NAME_FREE                   2.537
> +score HK_SCAM_N2                     3.099
>   score KHOP_SC_TOP200                 3.999
> -score KHOP_SC_TOP_CIDR16             0.001
> -score KHOP_SC_TOP_CIDR8              0.000
> -score MANY_GOOG_PROXY                0.001
> -score MANY_SPAN_IN_TEXT              1.338
> -score MONEY_FROM_MISSP               1.063
> -score S25R_1                         0.000
> -score S25R_4                         1.159
> -score S25R_6                         3.200
> -score SANE_75491b468ec2e117e50f9842d32abfab 0.722
> -score SANE_b58d7945d89b7afc9e2753c83b00ab44 1.133
> -score TAB_IN_FROM                    0.001
> -score TO_NO_BRKTS_DYNIP              0.001
> -score TVD_PCT_OFF                    0.765
> -score TWO_IPS_RCVD                   1.499
> +score KHOP_SC_TOP_CIDR16             3.288
> +score KHOP_SC_TOP_CIDR8              0.369
> +score LOTTO_AGENT                    2.899
> +score MANY_SPAN_IN_TEXT              2.365
> +score S25R_3                         2.289
> +score TAB_IN_FROM                    3.114
> +score TINY_FLOAT                     3.799
>
> Modified: spamassassin/trunk/rulesrc/scores/scores-set2
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set2?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/scores-set2 (original)
> +++ spamassassin/trunk/rulesrc/scores/scores-set2 Tue Feb 23 03:21:53 2010
> @@ -1,35 +1,44 @@
> -# Using score set 0 logs for revision 910179 from:
> -# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
> spam-bb-doc.log spam-bb-fredt.log spam-bb-guenther_fraud.log
> +# Using score set 0 logs for revision 912513 from:
> +# ham-bb-doc.log ham-bb-fredt.log ham-bb-guenther_fraud.log
> ham-bb-jhardin.log ham-bb-jhardin_fraud.log ham-bb-jm.log
> ham-bb-kmcgrail.log ham-bb-trec_enron.log ham-bb-zmi.log
> ham-bernie-it_batt.log ham-bernie-mix.log ham-dos.log ham-jm.log
> ham-wt-en1.log ham-wt-en2.log ham-wt-en3.log ham-wt-en4.log
> ham-wt-en5.log ham-wt-jp1.log ham-wt-jp2.log spam-bb-doc.log
> spam-bb-fredt.log spam-bb-guenther_fraud.log spam-bb-jhardin.log
> spam-bb-jhardin_fraud.log spam-bb-jm.log spam-bb-kmcgrail.log
> spam-bb-trec_enron.log spam-bb-zmi.log spam-bernie-it_batt.log
> spam-bernie-mix.log spam-dos.log spam-jm.log spam-wt-en1.log
> spam-wt-en2.log spam-wt-en3.log spam-wt-en4.log spam-wt-en5.log
> spam-wt-jp1.log spam-wt-jp2.log
>
> +score AXB_HELO_HOME_UN               3.899
> +score DATE_IN_FUTURE_96_Q            2.893
> +score DATE_IN_FUTURE_Q_PLUS          0.001
>   score DEAR_BENEFICIARY               2.899
> -score FILL_THIS_FORM                 0.530
> -score FORM_FRAUD                     3.900
> -score FROM_MISSPACED                 2.201
> -score FROM_MISSP_DYNIP               1.925
> -score FROM_MISSP_FREEMAIL            1.859
> -score FROM_MISSP_MSFT                3.300
> -score FROM_URI                       0.207
> -score FROM_WWW                       2.003
> -score FSL_UA                         1.622
> -score HELO_NO_DOMAIN                 2.320
> -score HK_LOTTO_NAME                  0.927
> -score HK_NAME_FM_DR                  0.643
> -score HK_SCAM_N1                     1.467
> -score HK_SCAM_N15                    2.199
> -score HK_SCAM_N2                     3.199
> -score HK_SCAM_N3                     2.522
> -score HK_SCAM_N8                     2.187
> -score HK_SCAM_S25                    0.531
> -score HK_SPAMMY_FILENAME             0.511
> -score KAM_LOTTO3                     0.086
> -score KHOP_SC_TOP200                 0.894
> -score KHOP_SC_TOP_CIDR8              2.700
> -score LOTTO_AGENT                    1.448
> -score LOTTO_DEPT                     0.936
> -score LOTTO_URI                      0.796
> -score MONEY_FORM                     1.420
> -score MONEY_FROM_MISSP               1.968
> -score MONEY_PERCENT                  2.623
> -score OBFU_TEXT_ATTACH               0.022
> -score TO_NO_BRKTS_DYNIP              0.258
> -score TWO_IPS_RCVD                   1.722
> +score DEAR_EMAIL                     0.001
> +score DOS_HIGHBIT_HDRS_BODY          3.799
> +score FORGED_RELAY_MUA_TO_MX         3.479
> +score FORGED_TBIRD_IMG_ARROW         3.557
> +score FORGED_TBIRD_IMG_SIZE          2.457
> +score FORGED_TBIRD_IMG_TO_MX         1.871
> +score FROM_MISSP_DYNIP               2.544
> +score FROM_MISSP_FREEMAIL            3.499
> +score FROM_MISSP_MSFT                3.699
> +score FROM_URI                       1.772
> +score FROM_WWW                       0.829
> +score FR_TITLE_CONS_6                3.000
> +score FSL_LSPACES_ABUSE              3.551
> +score FS_MORE_CONFIDENT              1.052
> +score HELO_NO_DOMAIN                 2.638
> +score HK_FAKENAME_MICROSOFT          2.799
> +score HK_NAME_FREE                   2.601
> +score HK_RANDOM_FROM                 2.100
> +score HK_SCAM_N2                     1.690
> +score IMG_DIRECT_TO_MX               3.999
> +score KHOP_SC_CIDR16                 3.637
> +score KHOP_SC_CIDR24                 3.359
> +score KHOP_SC_TOP200                 3.999
> +score KHOP_SC_TOP_CIDR16             0.001
> +score KHOP_SC_TOP_CIDR8              2.602
> +score LOTTO_AGENT                    2.999
> +score MANY_GOOG_PROXY                2.899
> +score MANY_SPAN_IN_TEXT              0.001
> +score S25R_1                         0.711
> +score S25R_3                         3.799
> +score S25R_6                         3.199
> +score SANE_75491b468ec2e117e50f9842d32abfab 2.799
> +score TAB_IN_FROM                    0.863
> +score TINY_FLOAT                     3.799
> +score TO_NO_BRKTS_DYNIP              0.001
> +score TVD_PCT_OFF                    2.953
> +score TWO_IPS_RCVD                   0.001
>
> Modified: spamassassin/trunk/rulesrc/scores/scores-set3
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/scores-set3?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/scores-set3 (original)
> +++ spamassassin/trunk/rulesrc/scores/scores-set3 Tue Feb 23 03:21:53 2010
> @@ -1,42 +1,20 @@
> -# Using score set 1 logs for revision 907194 from:
> +# Using score set 1 logs for revision 912093 from:
>   # ham-net-bb-doc.log ham-net-bb-fredt.log ham-net-bb-guenther_fraud.log
> ham-net-bb-jhardin.log ham-net-bb-jhardin_fraud.log ham-net-bb-jm.log
> ham-net-bb-kmcgrail.log ham-net-bb-trec_enron.log ham-net-bb-zmi.log
> ham-net-bernie-it_batt.log ham-net-bernie-mix.log ham-net-dos.log
> ham-net-jm.log ham-net-kgolding.log ham-net-wt-en1.log
> ham-net-wt-en2.log ham-net-wt-en3.log ham-net-wt-en4.log
> ham-net-wt-en5.log ham-net-wt-jp1.log ham-net-wt-jp2.log
> spam-net-bb-doc.log spam-net-bb-fredt.log spam-net-bb-guenther_fraud.log
> spam-net-bb-jhardin.log spam-net-bb-jhardin_fraud.log spam-net-bb-jm.log
> spam-net-bb-kmcgrail.log spam-net-bb-trec_enron.log spam-net-bb-zmi.log
> spam-net-bernie-it_batt.log spam-net-bernie-mix.log spam-net-dos.log
> spam-net-jm.log spam-net-kgolding.log spam-net-wt-en1.log
> spam-net-wt-en2.log spam-net-wt-en3.log spam-net-wt-en4.log
> spam-net-wt-en5.log spam-net-wt-jp1.log spam-net-wt-jp2.log
>
> -score AXB_HELO_HOME_UN               0.001
> -score AXB_URI_APE_ABUSE2             2.904
> -score DATE_IN_FUTURE_Q_PLUS          0.001
> +score AXB_HELO_HOME_UN               2.187
>   score DEAR_BENEFICIARY               2.799
> -score DEAR_EMAIL                     0.001
> -score DOS_HIGHBIT_HDRS_BODY          2.559
> -score FORGED_RELAY_MUA_TO_MX         3.600
> -score FORGED_TBIRD_IMG_ARROW         1.560
> -score FORGED_TBIRD_IMG_SIZE          1.166
> -score FORGED_TBIRD_IMG_TO_MX         3.319
> -score FROM_MISSP_DYNIP               0.001
> -score FROM_MISSP_FREEMAIL            3.399
> +score FORGED_RELAY_MUA_TO_MX         0.000
> +score FROM_MISSP_DYNIP               1.333
> +score FROM_MISSP_FREEMAIL            3.500
>   score FROM_MISSP_MSFT                0.001
> -score FROM_URI                       2.143
> -score FROM_WWW                       2.051
> -score FRT_ERECTION                   2.222
> -score FSL_LSPACES_ABUSE              0.001
> -score HDRS_MISSP                     0.001
> -score HELO_NO_DOMAIN                 0.000
> -score HK_NAME_FREE                   2.780
> -score HK_SCAM_N2                     1.733
> -score IMG_DIRECT_TO_MX               0.001
> -score KHOP_SC_CIDR16                 0.001
> -score KHOP_SC_CIDR24                 1.426
> +score HK_FAKENAME_MICROSOFT          3.600
> +score HK_NAME_FREE                   2.537
> +score HK_SCAM_N2                     3.099
>   score KHOP_SC_TOP200                 3.999
> -score KHOP_SC_TOP_CIDR16             0.001
> -score KHOP_SC_TOP_CIDR8              0.000
> -score MANY_GOOG_PROXY                0.001
> -score MANY_SPAN_IN_TEXT              1.338
> -score MONEY_FROM_MISSP               1.063
> -score S25R_1                         0.000
> -score S25R_4                         1.159
> -score S25R_6                         3.200
> -score SANE_75491b468ec2e117e50f9842d32abfab 0.722
> -score SANE_b58d7945d89b7afc9e2753c83b00ab44 1.133
> -score TAB_IN_FROM                    0.001
> -score TO_NO_BRKTS_DYNIP              0.001
> -score TVD_PCT_OFF                    0.765
> -score TWO_IPS_RCVD                   1.499
> +score KHOP_SC_TOP_CIDR16             3.288
> +score KHOP_SC_TOP_CIDR8              0.369
> +score LOTTO_AGENT                    2.899
> +score MANY_SPAN_IN_TEXT              2.365
> +score S25R_3                         2.289
> +score TAB_IN_FROM                    3.114
> +score TINY_FLOAT                     3.799
>
> Modified: spamassassin/trunk/rulesrc/scores/stats-set0
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/stats-set0?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/stats-set0 (original)
> +++ spamassassin/trunk/rulesrc/scores/stats-set0 Tue Feb 23 03:21:53 2010
> @@ -1,32 +1,40 @@
>   ##### WITH NEW RULES AND SCORES #####
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam:      2  0.336%  (100.000% of non-spam corpus)
> -# Correctly spam:        555  93.121%  (93.434% of spam corpus)
> -# False positives:         0  0.000%  (0.000% of nonspam,      0 weighted)
> -# False negatives:        39  6.544%  (6.566% of spam,     92 weighted)
> -# Average score for spam:  24.6    nonspam: 2.8
> -# Average for false-pos:   -NaN  false-neg: 2.4
> -# TOTAL:                 596  100.00%
> +# Correctly non-spam: 130247  12.143%  (98.572% of non-spam corpus)
> +# Correctly spam:     899718  83.884%  (95.670% of spam corpus)
> +# False positives:      1887  0.176%  (1.428% of nonspam, 435137 weighted)
> +# False negatives:     40724  3.797%  (4.330% of spam,  93995 weighted)
> +# Average score for spam:  14.7    nonspam: 0.4
> +# Average for false-pos:   6.5  false-neg: 2.3
> +# TOTAL:              1072576  100.00%
>
>   Reading scores from "tmprules"...
> +Reading per-message hit stat logs and scores...
> +
> +# SUMMARY for threshold 5.0:
> +# Correctly non-spam:  16339  98.55%
> +# Correctly spam:     112412  95.74%
> +# False positives:       241  1.45%
> +# False negatives:      5007  4.26%
> +# TCR(l=50): 6.883919  SpamRecall: 95.736%  SpamPrec: 99.786%
>
>   ##### WITHOUT NEW RULES AND SCORES #####
>   Reading scores from "../rules-base"...
>   Reading per-message hit stat logs and scores...
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam:      2  100.00%
> -# Correctly spam:        436  73.40%
> -# False positives:         0  0.00%
> -# False negatives:       158  26.60%
> -# TCR(l=50): 3.759494  SpamRecall: 73.401%  SpamPrec: 100.000%
> +# Correctly non-spam: 130473  98.74%
> +# Correctly spam:     641489  68.21%
> +# False positives:      1661  1.26%
> +# False negatives:    298953  31.79%
> +# TCR(l=50): 2.461871  SpamRecall: 68.211%  SpamPrec: 99.742%
>   Reading scores from "../rules-base"...
>   Reading per-message hit stat logs and scores...
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam:      1  100.00%
> -# Correctly spam:         49  75.38%
> -# False positives:         0  0.00%
> -# False negatives:        16  24.62%
> -# TCR(l=50): 4.062500  SpamRecall: 75.385%  SpamPrec: 100.000%
> +# Correctly non-spam:  16390  98.85%
> +# Correctly spam:      80029  68.16%
> +# False positives:       190  1.15%
> +# False negatives:     37390  31.84%
> +# TCR(l=50): 2.504137  SpamRecall: 68.157%  SpamPrec: 99.763%
>
> Modified: spamassassin/trunk/rulesrc/scores/stats-set1
> URL:
> http://svn.apache.org/viewvc/spamassassin/trunk/rulesrc/scores/stats-set1?rev=915157&r1=915156&r2=915157&view=diff
> ==============================================================================
> --- spamassassin/trunk/rulesrc/scores/stats-set1 (original)
> +++ spamassassin/trunk/rulesrc/scores/stats-set1 Tue Feb 23 03:21:53 2010
> @@ -1,40 +1,40 @@
>   ##### WITH NEW RULES AND SCORES #####
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam: 132400  13.291%  (98.974% of non-spam corpus)
> -# Correctly spam:     855253  85.852%  (99.169% of spam corpus)
> -# False positives:      1372  0.138%  (1.026% of nonspam, 1574316 weighted)
> -# False negatives:      7171  0.720%  (0.831% of spam,  19669 weighted)
> -# Average score for spam:  23.1    nonspam: -0.9
> -# Average for false-pos:   17.8  false-neg: 2.7
> -# TOTAL:              996196  100.00%
> +# Correctly non-spam: 132947  12.408%  (99.725% of non-spam corpus)
> +# Correctly spam:     930734  86.864%  (99.207% of spam corpus)
> +# False positives:       367  0.034%  (0.275% of nonspam, 154836 weighted)
> +# False negatives:      7437  0.694%  (0.793% of spam,  21854 weighted)
> +# Average score for spam:  23.0    nonspam: -1.1
> +# Average for false-pos:   6.0  false-neg: 2.9
> +# TOTAL:              1071485  100.00%
>
>   Reading scores from "tmprules"...
>   Reading per-message hit stat logs and scores...
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam:  16585  98.93%
> -# Correctly spam:     106696  99.15%
> -# False positives:       180  1.07%
> -# False negatives:       917  0.85%
> -# TCR(l=50): 10.851366  SpamRecall: 99.148%  SpamPrec: 99.832%
> +# Correctly non-spam:  16653  99.70%
> +# Correctly spam:     116258  99.28%
> +# False positives:        50  0.30%
> +# False negatives:       841  0.72%
> +# TCR(l=50): 35.049087  SpamRecall: 99.282%  SpamPrec: 99.957%
>
>   ##### WITHOUT NEW RULES AND SCORES #####
>   Reading scores from "../rules-base"...
>   Reading per-message hit stat logs and scores...
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam: 132307  98.90%
> -# Correctly spam:     839199  97.31%
> -# False positives:      1465  1.10%
> -# False negatives:     23225  2.69%
> -# TCR(l=50): 8.939352  SpamRecall: 97.307%  SpamPrec: 99.826%
> +# Correctly non-spam: 132853  99.65%
> +# Correctly spam:     914814  97.51%
> +# False positives:       461  0.35%
> +# False negatives:     23357  2.49%
> +# TCR(l=50): 20.216153  SpamRecall: 97.510%  SpamPrec: 99.950%
>   Reading scores from "../rules-base"...
>   Reading per-message hit stat logs and scores...
>
>   # SUMMARY for threshold 5.0:
> -# Correctly non-spam:  16575  98.87%
> -# Correctly spam:     104639  97.24%
> -# False positives:       190  1.13%
> -# False negatives:      2974  2.76%
> -# TCR(l=50): 8.626984  SpamRecall: 97.236%  SpamPrec: 99.819%
> +# Correctly non-spam:  16638  99.61%
> +# Correctly spam:     114267  97.58%
> +# False positives:        65  0.39%
> +# False negatives:      2832  2.42%
> +# TCR(l=50): 19.253371  SpamRecall: 97.582%  SpamPrec: 99.943%
>    


Re: Automated Rule Updates with Scores Now Functional

Posted by Justin Mason <jm...@jmason.org>.
this is awesome, Daryl! ;)  nice one.

--j.

On Tue, Feb 23, 2010 at 23:41, Daryl C. W. O'Shea
<sp...@dostech.ca> wrote:
> On 23/02/2010 10:55 AM, Warren Togami wrote:
>> Rules checked into trunk are propagated automatically to the 3.3.x channel?
>
> Yes.
>
>> If not, and only rules checked into 3.3.x are auto scored, is this
>> really a good thing given that the masschecks are for trunk, not 3.3.x
>> branch?
>
> Yeah, I don't see how that would work too well.  Applying statistics
> from one thing to something else usually doesn't yield sensible results.
>
> Of course, using rules and stats from trunk for another version (3.3 in
> this case) isn't necessarily the most accurate way either as parser
> changes can, often intentially, change hit rates of rules.  I don't
> think anybody is too excited about running stable version mass-checks,
> though, and it won't solve the problem for already released versions of
> SA anyway.
>
> Daryl
>
>



-- 
--j.

Re: Automated Rule Updates with Scores Now Functional

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
On 23/02/2010 10:55 AM, Warren Togami wrote:
> Rules checked into trunk are propagated automatically to the 3.3.x channel?

Yes.

> If not, and only rules checked into 3.3.x are auto scored, is this
> really a good thing given that the masschecks are for trunk, not 3.3.x
> branch?

Yeah, I don't see how that would work too well.  Applying statistics
from one thing to something else usually doesn't yield sensible results.

Of course, using rules and stats from trunk for another version (3.3 in
this case) isn't necessarily the most accurate way either as parser
changes can, often intentially, change hit rates of rules.  I don't
think anybody is too excited about running stable version mass-checks,
though, and it won't solve the problem for already released versions of
SA anyway.

Daryl

Re: Automated Rule Updates with Scores Now Functional

Posted by Warren Togami <wt...@redhat.com>.
On 02/23/2010 12:29 AM, Daryl C. W. O'Shea wrote:
> FYI... automated score generation and rule update releases for the 3.3
> stable branch is now functional (actually, it has been for a week but
> there haven't been enough mass-check submissions until now).
>
> The update creation process includes testing of the rule updates on each
> targeted version of SpamAssassin (currently 3.3.0 and 3.3.1) to ensure
> that the rules will install successfully on each version.
>
> trunk rule updates remain as they have always been.
>
> Daryl
>

Rules checked into trunk are propagated automatically to the 3.3.x channel?

If not, and only rules checked into 3.3.x are auto scored, is this 
really a good thing given that the masschecks are for trunk, not 3.3.x 
branch?

Warren