You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Yet Another Ninja <ax...@gmail.com> on 2011/05/25 13:28:23 UTC

merged duplicates

I'm seeing a lot of  merged duplicates rules and unless there's a heavy 
reason to keep it this way I see this ugly sloppyness.

Would it be possible to clean this up?
Sandbox owners?

Comments?

thx

AxB

May 25 12:24:07.168 [22619] dbg: rules: __MO_OL_9B90B merged duplicates: 
__MO_OL_C65FA
May 25 12:24:07.168 [22619] dbg: rules: __XM_OL_22B61 merged duplicates: 
__XM_OL_A842E
May 25 12:24:07.169 [22619] dbg: rules: __MO_OL_07794 merged duplicates: 
__MO_OL_8627E __MO_OL_F3B05
May 25 12:24:07.169 [22619] dbg: rules: __JM_REACTOR_DATE merged 
duplicates: __RATWARE_0_TZ_DATE
May 25 12:24:07.169 [22619] dbg: rules: __XM_OL_07794 merged duplicates: 
__XM_OL_25340 __XM_OL_3857F __XM_OL_4F240 __XM_OL_58CB5 __XM_OL_6 
                                       554A __XM_OL_812FF __XM_OL_C65FA 
__XM_OL_CF0C0 __XM_OL_F475E __XM_OL_F6D01
May 25 12:24:07.169 [22619] dbg: rules: FH_MSGID_01C67 merged 
duplicates: __MSGID_VGA
May 25 12:24:07.169 [22619] dbg: rules: FS_NEW_SOFT_UPLOAD merged 
duplicates: HS_SUBJ_NEW_SOFTWARE
May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_91287 merged duplicates: 
__MO_OL_B30D1 __MO_OL_CF0C0
May 25 12:24:07.170 [22619] dbg: rules: KAM_STOCKOTC merged duplicates: 
KAM_STOCKTIP15 KAM_STOCKTIP20 KAM_STOCKTIP21 KAM_STOCKTIP4 KAM_STO 
                                        CKTIP6
May 25 12:24:07.170 [22619] dbg: rules: __XM_OL_015D5 merged duplicates: 
__XM_OL_4BF4C __XM_OL_4EEDB __XM_OL_5B79A __XM_OL_9B90B __XM_OL_A 
                                       DFF7 __XM_OL_B30D1 __XM_OL_B4B40 
__XM_OL_BC7E6 __XM_OL_F3B05 __XM_OL_FF5C8
May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_015D5 merged duplicates: 
__MO_OL_6554A
May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_22B61 merged duplicates: 
__MO_OL_4F240 __MO_OL_ADFF7
May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_812FF merged duplicates: 
__MO_OL_BC7E6
May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_25340 merged duplicates: 
__MO_OL_4EEDB __MO_OL_7533E
May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_MAILING_LIST merged 
duplicates: __ML4 __freemail_safe_ml2
May 25 12:24:07.171 [22619] dbg: rules: __ML2 merged duplicates: 
__freemail_safe_ml1
May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_58CB5 merged duplicates: 
__MO_OL_B4B40
May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_ANY_URI merged 
duplicates: __HAS_ANY_URI
May 25 12:24:07.171 [22619] dbg: rules: __FH_HAS_XMSMAIL merged 
duplicates: __HAS_MSMAIL_PRI
May 25 12:24:07.172 [22619] dbg: rules: CTYPE_001C_A merged duplicates: 
DATE_IN_FUTURE_96_XX JM_SOUGHT_FRAUD_1
May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_72641 merged duplicates: 
__MO_OL_A842E
May 25 12:24:07.172 [22619] dbg: rules: __HAS_X_MAILING_LIST merged 
duplicates: __freemail_safe_ml3
May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_4BF4C merged duplicates: 
__MO_OL_F6D01
May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_F475E merged duplicates: 
__MO_OL_FF5C8

Re: merged duplicates

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
On 25/05/2011 7:28 AM, Yet Another Ninja wrote:
> I'm seeing a lot of merged duplicates rules and unless there's a heavy
> reason to keep it this way I see this ugly sloppyness.
>
> Would it be possible to clean this up?
> Sandbox owners?
>
> Comments?

What's the issue?  One of the primary reasons for merging duplicate 
rules is so that sandbox owners don't have to track other people's rules 
(possibly having other people breaking their meta rules inadvertantly). 
  I saw leave duplicates between different sandboxes as they are... it's 
by design.

Now duplicates within a sandbox, especially with auto-generated rules 
like the __XM ones could be avoided, but I don't really care if somebody 
doesn't have the time to fix such issues as there is "no" performance 
penalty anyway (it's nearly immeasurable IIRC, especially when 
duplicates are a small % of all rules).

Daryl

>
> thx
>
> AxB
>
> May 25 12:24:07.168 [22619] dbg: rules: __MO_OL_9B90B merged duplicates:
> __MO_OL_C65FA
> May 25 12:24:07.168 [22619] dbg: rules: __XM_OL_22B61 merged duplicates:
> __XM_OL_A842E
> May 25 12:24:07.169 [22619] dbg: rules: __MO_OL_07794 merged duplicates:
> __MO_OL_8627E __MO_OL_F3B05
> May 25 12:24:07.169 [22619] dbg: rules: __JM_REACTOR_DATE merged
> duplicates: __RATWARE_0_TZ_DATE
> May 25 12:24:07.169 [22619] dbg: rules: __XM_OL_07794 merged duplicates:
> __XM_OL_25340 __XM_OL_3857F __XM_OL_4F240 __XM_OL_58CB5 __XM_OL_6 554A
> __XM_OL_812FF __XM_OL_C65FA __XM_OL_CF0C0 __XM_OL_F475E __XM_OL_F6D01
> May 25 12:24:07.169 [22619] dbg: rules: FH_MSGID_01C67 merged
> duplicates: __MSGID_VGA
> May 25 12:24:07.169 [22619] dbg: rules: FS_NEW_SOFT_UPLOAD merged
> duplicates: HS_SUBJ_NEW_SOFTWARE
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_91287 merged duplicates:
> __MO_OL_B30D1 __MO_OL_CF0C0
> May 25 12:24:07.170 [22619] dbg: rules: KAM_STOCKOTC merged duplicates:
> KAM_STOCKTIP15 KAM_STOCKTIP20 KAM_STOCKTIP21 KAM_STOCKTIP4 KAM_STO CKTIP6
> May 25 12:24:07.170 [22619] dbg: rules: __XM_OL_015D5 merged duplicates:
> __XM_OL_4BF4C __XM_OL_4EEDB __XM_OL_5B79A __XM_OL_9B90B __XM_OL_A DFF7
> __XM_OL_B30D1 __XM_OL_B4B40 __XM_OL_BC7E6 __XM_OL_F3B05 __XM_OL_FF5C8
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_015D5 merged duplicates:
> __MO_OL_6554A
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_22B61 merged duplicates:
> __MO_OL_4F240 __MO_OL_ADFF7
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_812FF merged duplicates:
> __MO_OL_BC7E6
> May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_25340 merged duplicates:
> __MO_OL_4EEDB __MO_OL_7533E
> May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_MAILING_LIST merged
> duplicates: __ML4 __freemail_safe_ml2
> May 25 12:24:07.171 [22619] dbg: rules: __ML2 merged duplicates:
> __freemail_safe_ml1
> May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_58CB5 merged duplicates:
> __MO_OL_B4B40
> May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_ANY_URI merged
> duplicates: __HAS_ANY_URI
> May 25 12:24:07.171 [22619] dbg: rules: __FH_HAS_XMSMAIL merged
> duplicates: __HAS_MSMAIL_PRI
> May 25 12:24:07.172 [22619] dbg: rules: CTYPE_001C_A merged duplicates:
> DATE_IN_FUTURE_96_XX JM_SOUGHT_FRAUD_1
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_72641 merged duplicates:
> __MO_OL_A842E
> May 25 12:24:07.172 [22619] dbg: rules: __HAS_X_MAILING_LIST merged
> duplicates: __freemail_safe_ml3
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_4BF4C merged duplicates:
> __MO_OL_F6D01
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_F475E merged duplicates:
> __MO_OL_FF5C8


Re: merged duplicates

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
I thought that my 80_deadrules.cf was supposed to fix mine so I've moved 
all my sandbox cf files to *.cf.old and committed.  Let me know if that 
helps.

Regards,
KAM

On 5/25/2011 7:28 AM, Yet Another Ninja wrote:
> I'm seeing a lot of  merged duplicates rules and unless there's a 
> heavy reason to keep it this way I see this ugly sloppyness.
>
> Would it be possible to clean this up?
> Sandbox owners?
>
> Comments?
>
> thx
>
> AxB
>
> May 25 12:24:07.168 [22619] dbg: rules: __MO_OL_9B90B merged 
> duplicates: __MO_OL_C65FA
> May 25 12:24:07.168 [22619] dbg: rules: __XM_OL_22B61 merged 
> duplicates: __XM_OL_A842E
> May 25 12:24:07.169 [22619] dbg: rules: __MO_OL_07794 merged 
> duplicates: __MO_OL_8627E __MO_OL_F3B05
> May 25 12:24:07.169 [22619] dbg: rules: __JM_REACTOR_DATE merged 
> duplicates: __RATWARE_0_TZ_DATE
> May 25 12:24:07.169 [22619] dbg: rules: __XM_OL_07794 merged 
> duplicates: __XM_OL_25340 __XM_OL_3857F __XM_OL_4F240 __XM_OL_58CB5 
> __XM_OL_6                                       554A __XM_OL_812FF 
> __XM_OL_C65FA __XM_OL_CF0C0 __XM_OL_F475E __XM_OL_F6D01
> May 25 12:24:07.169 [22619] dbg: rules: FH_MSGID_01C67 merged 
> duplicates: __MSGID_VGA
> May 25 12:24:07.169 [22619] dbg: rules: FS_NEW_SOFT_UPLOAD merged 
> duplicates: HS_SUBJ_NEW_SOFTWARE
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_91287 merged 
> duplicates: __MO_OL_B30D1 __MO_OL_CF0C0
> May 25 12:24:07.170 [22619] dbg: rules: KAM_STOCKOTC merged 
> duplicates: KAM_STOCKTIP15 KAM_STOCKTIP20 KAM_STOCKTIP21 KAM_STOCKTIP4 
> KAM_STO                                        CKTIP6
> May 25 12:24:07.170 [22619] dbg: rules: __XM_OL_015D5 merged 
> duplicates: __XM_OL_4BF4C __XM_OL_4EEDB __XM_OL_5B79A __XM_OL_9B90B 
> __XM_OL_A                                       DFF7 __XM_OL_B30D1 
> __XM_OL_B4B40 __XM_OL_BC7E6 __XM_OL_F3B05 __XM_OL_FF5C8
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_015D5 merged 
> duplicates: __MO_OL_6554A
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_22B61 merged 
> duplicates: __MO_OL_4F240 __MO_OL_ADFF7
> May 25 12:24:07.170 [22619] dbg: rules: __MO_OL_812FF merged 
> duplicates: __MO_OL_BC7E6
> May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_25340 merged 
> duplicates: __MO_OL_4EEDB __MO_OL_7533E
> May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_MAILING_LIST merged 
> duplicates: __ML4 __freemail_safe_ml2
> May 25 12:24:07.171 [22619] dbg: rules: __ML2 merged duplicates: 
> __freemail_safe_ml1
> May 25 12:24:07.171 [22619] dbg: rules: __MO_OL_58CB5 merged 
> duplicates: __MO_OL_B4B40
> May 25 12:24:07.171 [22619] dbg: rules: __DOS_HAS_ANY_URI merged 
> duplicates: __HAS_ANY_URI
> May 25 12:24:07.171 [22619] dbg: rules: __FH_HAS_XMSMAIL merged 
> duplicates: __HAS_MSMAIL_PRI
> May 25 12:24:07.172 [22619] dbg: rules: CTYPE_001C_A merged 
> duplicates: DATE_IN_FUTURE_96_XX JM_SOUGHT_FRAUD_1
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_72641 merged 
> duplicates: __MO_OL_A842E
> May 25 12:24:07.172 [22619] dbg: rules: __HAS_X_MAILING_LIST merged 
> duplicates: __freemail_safe_ml3
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_4BF4C merged 
> duplicates: __MO_OL_F6D01
> May 25 12:24:07.172 [22619] dbg: rules: __MO_OL_F475E merged 
> duplicates: __MO_OL_FF5C8