You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by "Koopmann, Jan-Peter" <ja...@koopmann.eu> on 2007/05/16 09:14:31 UTC

sa-compile and SARE

Hi,
 
please excuse me if the archives already answer the question and I overlooked it.
 
I am going to upgrade to 3.2.0 this week but remember reading that sa-compile will not work with SARE rules currently. If I understand it correctly when using sa-compile it will be used for all rules so you cannot use sa-compile for the "working" rules and have others not compiled?
 
Therefore the question: Someone wrote all SARE rules would be updated these days so they are compatible with sa-compile. Is there some new status?
 
 
Kind regards,
  JP

Re: sa-compile and SARE

Posted by Loren Wilton <lw...@earthlink.net>.
> Does this fix the performance problems I was having, or does it just fix
> the UTF errors showing in the logs with Perl < 5.8.8 ?

Just fixes the problems with the errors.

        Loren



RE: sa-compile and SARE

Posted by "Rosenbaum, Larry M." <ro...@ornl.gov>.
> From: Doc Schneider [mailto:maddoc@maddoc.net]
> 
> Rosenbaum, Larry M. wrote:
> >
> > Does this fix the performance problems I was having, or does it just
> fix
> > the UTF errors showing in the logs with Perl < 5.8.8 ?
> 
> You might try it and see if it helps with the performance. Since it
> does
> fix the UTF-8 issue it won't be doing as much logging and grinding.
let
> us know if it helps.

Performance is still bad unless I "use bytes".

Re: sa-compile and SARE

Posted by Loren Wilton <lw...@earthlink.net>.
That would appear to be an unrelated problem, since none of those rules use 
high-bit characters.

Since there doesn't appear to be anything wrong with the rules themselves, I 
would think it is a problem with either SA or the way it is being called.

That said, we can check again on the hit rates on those rules.

        Loren

----- Original Message ----- 
From: "Bret Miller" <br...@wcg.org>
To: <us...@spamassassin.apache.org>
Sent: Wednesday, May 23, 2007 3:49 PM
Subject: RE: sa-compile and SARE


> > Does this fix the performance problems I was having, or
> does it just fix
> > the UTF errors showing in the logs with Perl < 5.8.8 ?
>
> You might try it and see if it helps with the performance.
> Since it does
> fix the UTF-8 issue it won't be doing as much logging and
> grinding. let us know if it helps.

The sare obfu1 set is still crashing when calling the sa perl object on
Windows.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5425

I expect there's nothing that the SA devs are going to be able to do to
catch it, but in case there's a way to rework the rule so it doesn't
crash, I thought I'd let someone know. It would be good for Windows
users to remove the obfu set (obfu0 is ok, but obfu and obfu1 are not)
if they're upgrading to SA 3.2.0.

Bret




RE: sa-compile and SARE

Posted by Bret Miller <br...@wcg.org>.
> > Does this fix the performance problems I was having, or 
> does it just fix
> > the UTF errors showing in the logs with Perl < 5.8.8 ?
> 
> You might try it and see if it helps with the performance. 
> Since it does
> fix the UTF-8 issue it won't be doing as much logging and 
> grinding. let us know if it helps.

The sare obfu1 set is still crashing when calling the sa perl object on
Windows.
http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5425

I expect there's nothing that the SA devs are going to be able to do to
catch it, but in case there's a way to rework the rule so it doesn't
crash, I thought I'd let someone know. It would be good for Windows
users to remove the obfu set (obfu0 is ok, but obfu and obfu1 are not)
if they're upgrading to SA 3.2.0.

Bret




Re: sa-compile and SARE

Posted by Doc Schneider <ma...@maddoc.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Rosenbaum, Larry M. wrote:
>
> Does this fix the performance problems I was having, or does it just fix
> the UTF errors showing in the logs with Perl < 5.8.8 ?

You might try it and see if it helps with the performance. Since it does
fix the UTF-8 issue it won't be doing as much logging and grinding. let
us know if it helps.
- --

 -Doc

 Penguins: Do it on the ice.
   8:44am  up 4 days, 16:55, 17 users,  load average: 0.18, 0.30, 0.37

 SARE HQ  http://www.rulesemporium.com/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with CentOS - http://enigmail.mozdev.org

iD8DBQFGU0K8qOEeBwEpgcsRAoE9AJ92T+5Otcdfjz1DymJTh/qU7ply3ACfUqlK
jSq8y2a09MR+sEYvNKuPMLs=
=xN4w
-----END PGP SIGNATURE-----

RE: sa-compile and SARE

Posted by "Rosenbaum, Larry M." <ro...@ornl.gov>.

> -----Original Message-----
> From: Loren Wilton [mailto:lwilton@earthlink.net]
> Sent: Tuesday, May 22, 2007 1:36 PM
> To: users@spamassassin.apache.org
> Subject: Re: sa-compile and SARE
> 
> > So, can we now remove the "use bytes;" line?
> 
> Should be able to.  If this doesn't work we have some more files that
need
> to be updated, and would like to know what they might be.
> 

Does this fix the performance problems I was having, or does it just fix
the UTF errors showing in the logs with Perl < 5.8.8 ?

Re: sa-compile and SARE

Posted by Jerry Durand <jd...@interstellar.com>.
At 10:36 AM 5/22/2007, Loren Wilton wrote:
>>So, can we now remove the "use bytes;" line?
>
>Should be able to.  If this doesn't work we have some more files 
>that need to be updated, and would like to know what they might be.

Ok, done.  I'll post any timeouts that happen.

Here's the short version of the -D --lint run, I also see there are a 
lot of duplicates being merged.  The full dump is here:
http://interstellar.com/temp/SA.txt

[1185] dbg: rules: __MO_OL_F475E merged duplicates: __MO_OL_FF5C8\
[1185] dbg: rules: meta test DIGEST_MULTIPLE has undefined dependency 
'RAZOR2_CHECK'\
[1185] dbg: rules: meta test DIGEST_MULTIPLE has undefined dependency 
'DCC_CHECK'\
[1185] dbg: rules: meta test SARE_HEAD_SUBJ_RAND has undefined 
dependency 'SARE_XMAIL_SUSP2'\
[1185] dbg: rules: meta test SARE_HEAD_SUBJ_RAND has undefined 
dependency 'SARE_HEAD_XAUTH_WARN'\
[1185] dbg: rules: meta test SARE_HEAD_SUBJ_RAND has undefined 
dependency 'X_AUTH_WARN_FAKED'\
[1185] dbg: rules: meta test SARE_RD_SAFE has undefined dependency 
'SARE_RD_SAFE_MKSHRT'\
[1185] dbg: rules: meta test SARE_RD_SAFE has undefined dependency 
'SARE_RD_SAFE_GT'\
[1185] dbg: rules: meta test SARE_RD_SAFE has undefined dependency 
'SARE_RD_SAFE_TINY'\
[1185] dbg: rules: meta test SARE_OBFU_PRICE2 has undefined 
dependency '__SARE_OBFU_PRICE1'\




-- 
Jerry Durand, Durand Interstellar, Inc.  www.interstellar.com
tel: +1 408 356-3886, USA toll free: 1 866 356-3886
Skype:  jerrydurand


Re: sa-compile and SARE

Posted by Loren Wilton <lw...@earthlink.net>.
> So, can we now remove the "use bytes;" line?

Should be able to.  If this doesn't work we have some more files that need 
to be updated, and would like to know what they might be.

        Loren



Re: sa-compile and SARE

Posted by Jerry Durand <jd...@interstellar.com>.
At 06:47 AM 5/21/2007, Doc Schneider wrote:

>I just now committed fixed rule sets for SARE.
>
>Please give it an hour or so to become available. And also let me know
>if you're still seeing these issues.
>
>Thanks!


Thank you!

So, can we now remove the "use bytes;" line?



-- 
Jerry Durand, Durand Interstellar, Inc.  www.interstellar.com
tel: +1 408 356-3886, USA toll free: 1 866 356-3886
Skype:  jerrydurand


Re: sa-compile and SARE

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
Randal, Phil wrote:
> Doc Schneider wrote:
>> I just now committed fixed rule sets for SARE.
>>
>> Please give it an hour or so to become available. And also let me know
>> if you're still seeing these issues.
>>
>> Thanks!
> 
> Can you tell us which SARE rules were amended?

[dos@wally channels]$ ls -l | grep May\ 21 | cut -d' ' -f8-
May 21 10:14 70_sare_adult.cf
May 21 11:14 70_sare_obfu1.cf
May 21 10:14 72_sare_bml_post25x.cf
[dos@wally channels]$


RE: sa-compile and SARE

Posted by "Randal, Phil" <pr...@herefordshire.gov.uk>.
Doc Schneider wrote:
> 
> I just now committed fixed rule sets for SARE.
> 
> Please give it an hour or so to become available. And also let me know
> if you're still seeing these issues.
> 
> Thanks!

Can you tell us which SARE rules were amended?

Just so we can do a sanity check.

Cheers,

Phil
-- 
Phil Randal
Network Engineer
Herefordshire Council
Hereford, UK

Re: sa-compile and SARE

Posted by Michael Scheidell <sc...@secnap.net>.
Doc Schneider wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Michael Scheidell wrote:
>   
>>> Please give it an hour or so to become available. And also 
>>> let me know if you're still seeing these issues.
>>>
>>>       
>> Are they only available via channel? This brought old rule up:
>> http://www.rulesemporium.com/rules/70_sare_stocks.cf
>>     
>
> Rules are available several ways. Via Daryl's sa-update channel. Through
> the rulesemporium.com web site and also through Rules Du Jour. And what
> is old about sare_stocks? I updated it not long ago. 8*))
>
>   

more looking for updates to make sa-compile happy.

> - --
>
>  -Doc
>
>  Penguins: Do it on the ice.
>    8:44am  up 4 days, 16:55, 17 users,  load average: 0.18, 0.30, 0.37
>
>  SARE HQ  http://www.rulesemporium.com/
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.5 (GNU/Linux)
> Comment: Using GnuPG with CentOS - http://enigmail.mozdev.org
>
> iD8DBQFGUvqsqOEeBwEpgcsRAi5GAJ44IbQntpnld8v2Dhd9gHrr/lEBTgCfYwd8
> G52e64o4jbhSPx+zLrdapak=
> =sHaC
> -----END PGP SIGNATURE-----
>
>   


_________________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(tm). 
For Information please see http://www.spammertrap.com
_________________________________________________________________________

Re: sa-compile and SARE

Posted by Doc Schneider <ma...@maddoc.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Michael Scheidell wrote:
>> Please give it an hour or so to become available. And also 
>> let me know if you're still seeing these issues.
>>
> 
> Are they only available via channel? This brought old rule up:
> http://www.rulesemporium.com/rules/70_sare_stocks.cf

Rules are available several ways. Via Daryl's sa-update channel. Through
the rulesemporium.com web site and also through Rules Du Jour. And what
is old about sare_stocks? I updated it not long ago. 8*))

- --

 -Doc

 Penguins: Do it on the ice.
   8:44am  up 4 days, 16:55, 17 users,  load average: 0.18, 0.30, 0.37

 SARE HQ  http://www.rulesemporium.com/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with CentOS - http://enigmail.mozdev.org

iD8DBQFGUvqsqOEeBwEpgcsRAi5GAJ44IbQntpnld8v2Dhd9gHrr/lEBTgCfYwd8
G52e64o4jbhSPx+zLrdapak=
=sHaC
-----END PGP SIGNATURE-----

RE: sa-compile and SARE

Posted by Michael Scheidell <sc...@secnap.net>.
> 
> Please give it an hour or so to become available. And also 
> let me know if you're still seeing these issues.
> 

Are they only available via channel? This brought old rule up:
http://www.rulesemporium.com/rules/70_sare_stocks.cf


_________________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(tm). 
For Information please see http://www.spammertrap.com
_________________________________________________________________________

Re: sa-compile and SARE

Posted by Doc Schneider <ma...@maddoc.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Koopmann, Jan-Peter wrote:
> On Thursday, May 17, 2007 12:44 AM Doc Schneider wrote: 
> 
>> No, the 70_sare_stocks.cf was re-scored and a couple rules were
>> removed from it and had nothing to do with the UTF-8 issue. I've just
>> about gotten the rule sets that are causing that issue fixed. Look
>> for them in the next day or so. Of course, this all depends on other
>> factors. 8*) 
> 
> Could you drop us or the list a note once the rules are sa-compile
> compatible? :-)
> 
> Maybe some other rules have similar problems. If possible could you
> enlarge on what you did to the rules to make them work so I/we can
> contact the authors of other possible faulty rules?
> 
> 
> 
> Kind regards
> 
> Jan-Peter Koopmann

I just now committed fixed rule sets for SARE.

Please give it an hour or so to become available. And also let me know
if you're still seeing these issues.

Thanks!

- --

 -Doc

 Penguins: Do it on the ice.
   8:44am  up 4 days, 16:55, 17 users,  load average: 0.18, 0.30, 0.37

 SARE HQ  http://www.rulesemporium.com/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with CentOS - http://enigmail.mozdev.org

iD8DBQFGUaLpqOEeBwEpgcsRAm3mAJ9WOz6xNix0dZsWSKmCUPJ4yJaBeQCfYCBj
Scg4KBPqPZYnsj28dJPDi/o=
=xMnk
-----END PGP SIGNATURE-----

Re: sa-compile and SARE

Posted by Doc Schneider <ma...@maddoc.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Daryl C. W. O'Shea wrote:
> Koopmann, Jan-Peter wrote:
>> Hi,
>>  
>> please excuse me if the archives already answer the question and I
>> overlooked it.
>>  
>> I am going to upgrade to 3.2.0 this week but remember reading that
>> sa-compile will not work with SARE rules currently. If I understand it
>> correctly when using sa-compile it will be used for all rules so you
>> cannot use sa-compile for the "working" rules and have others not
>> compiled?
>>  
>> Therefore the question: Someone wrote all SARE rules would be updated
>> these days so they are compatible with sa-compile. Is there some new
>> status?
> 
> 70_sare_stocks.cf is the only ruleset that has been updated since the
> release of 3.2.0.  I don't believe the update was to fix any UTF8
> issues, nor do I know if there are any issues with this ruleset.
> 
> Daryl

No, the 70_sare_stocks.cf was re-scored and a couple rules were removed
from it and had nothing to do with the UTF-8 issue. I've just about
gotten the rule sets that are causing that issue fixed. Look for them in
the next day or so. Of course, this all depends on other factors. 8*)

- --

 -Doc

 Penguins: Do it on the ice.
   8:44am  up 4 days, 16:55, 17 users,  load average: 0.18, 0.30, 0.37

 SARE HQ  http://www.rulesemporium.com/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (GNU/Linux)
Comment: Using GnuPG with CentOS - http://enigmail.mozdev.org

iD8DBQFGS4khqOEeBwEpgcsRAjfDAJ9sbli0jlFgKqQ4WoAPQpcqGKOCSACgjovy
D5ivgPBXU8tovTrN3sBA9lA=
=qzAK
-----END PGP SIGNATURE-----

Re: sa-compile and SARE

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
Koopmann, Jan-Peter wrote:
> Hi,
>  
> please excuse me if the archives already answer the question and I 
> overlooked it.
>  
> I am going to upgrade to 3.2.0 this week but remember reading that 
> sa-compile will not work with SARE rules currently. If I understand it 
> correctly when using sa-compile it will be used for all rules so you 
> cannot use sa-compile for the "working" rules and have others not compiled?
>  
> Therefore the question: Someone wrote all SARE rules would be updated 
> these days so they are compatible with sa-compile. Is there some new status?

70_sare_stocks.cf is the only ruleset that has been updated since the 
release of 3.2.0.  I don't believe the update was to fix any UTF8 
issues, nor do I know if there are any issues with this ruleset.

Daryl