You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Daniel McDonald <da...@austinenergy.com> on 2011/08/15 16:07:53 UTC

Latest sa-update crashing sa-compile?

I just noticed that my cron-job for sa-update/sa-compile has crashed over
the weekend.

Spamassassin lints fine, but sa-compile fails:
Aug 15 08:59:42.970 [469] info: generic: base extraction starting. this can
take a while...
Aug 15 08:59:42.970 [469] info: generic: extracting from rules of type
body_0
100% [===========================================] 300.45 rules/sec 00m05s
DONE
100% [===========================================]  92.85 bases/sec 00m36s
DONE
Aug 15 09:00:25.846 [469] info: body_0: 1838 base strings extracted in 43
seconds
cd /tmp/.spamassassin469X5iW4Ytmp
cd Mail-SpamAssassin-CompiledRegexps-body_0
re2c -i -b -o scanner1.c scanner1.re
re2c -i -b -o scanner2.c scanner2.re
re2c: error: line 194, column 2: unterminated string constant (missing ")
command failed: exit 1


Any ideas where to look?  I¹m using the following channels:
updates.spamassassin.org
sought.rules.yerp.org

its sought_rules: Re: Latest sa-update crashing sa-compile?

Posted by Michael Scheidell <mi...@secnap.com>.
On 8/15/11 10:15 AM, Michael Scheidell wrote:
> On 8/15/11 10:13 AM, Michael Scheidell wrote:
>> On 8/15/11 10:07 AM, Daniel McDonald wrote:
>>>
>> mine too.  running sa-update again(just now) picks up a new build.
>> interesting, spamassassin --lint didn't pick anything up.
>>
>> also note, 'scanner2.c' is a blank file, 0 bytes\
>
> didn't help:  (tz is CEST)
>
> you also use sought_rules?
>
remove sought_rules:

rm -rf sought_rules_yerp_org*
rm z-INCLUDE-LATE.cf
  sa-compile




-- 
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
 >*| *SECNAP Network Security Corporation

    * Best Mobile Solutions Product of 2011
    * Best Intrusion Prevention Product
    * Hot Company Finalist 2011
    * Best Email Security Product
    * Certified SNORT Integrator


______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________

Re: Latest sa-update crashing sa-compile?

Posted by Michael Scheidell <mi...@secnap.com>.
On 8/15/11 10:27 AM, Bowie Bailey wrote:
> But that server is still running SA 3.3.1, so this may be caused by
> something that changed from 3.3.1 to 3.3.2.
>
might be 3.3.2.. we have 3.3.2 also.

I do have OLD sought rules on systems.  I started to see this fail at 
3:00am yesterday, CEST time (9pm EDT) and was able to stop it from 
updating systems in more eastern timezones, so I do have systems with 
sought rules that work.

see this diff:

<http://pastebin.com/57fU6X4D>




-- 
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
 >*| *SECNAP Network Security Corporation

    * Best Mobile Solutions Product of 2011
    * Best Intrusion Prevention Product
    * Hot Company Finalist 2011
    * Best Email Security Product
    * Certified SNORT Integrator

______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________

Re: Latest sa-update crashing sa-compile?

Posted by Bowie Bailey <Bo...@BUC.com>.
On 8/15/2011 10:15 AM, Michael Scheidell wrote:
> On 8/15/11 10:13 AM, Michael Scheidell wrote:
>> On 8/15/11 10:07 AM, Daniel McDonald wrote:
>>>
>> mine too.  running sa-update again(just now) picks up a new build.
>> interesting, spamassassin --lint didn't pick anything up.
>>
>> also note, 'scanner2.c' is a blank file, 0 bytes\
>
> didn't help:  (tz is CEST)
>
> you also use sought_rules?
>
>  sa-compile
> Aug 15 16:11:10.524 [56726] info: generic: base extraction starting.
> this can take a while...
> Aug 15 16:11:10.525 [56726] info: generic: extracting from rules of
> type body_0
> 100%
> [===============================================================================================]
> 7379.18 rules/sec 00m00s DONE
> 100%
> [===============================================================================================] 
> 57.19 bases/sec 02m18s DONE
> Aug 15 16:13:29.565 [56726] info: body_0: 5403 base strings extracted
> in 139 seconds
> cd /tmp/.spamassassin56726Bqzzg8tmp
> cd Mail-SpamAssassin-CompiledRegexps-body_0
> re2c -i -b -o scanner1.c scanner1.re
> re2c -i -b -o scanner2.c scanner2.re
> re2c: error: line 172, column 2: unterminated string constant (missing ")
> command failed: exit 1

I don't compile rules at the office, but I checked my home server and it
is not giving any errors on the compile.

Channels:
updates.spamassassin.org
sought.rules.yerp.org
khop-bl.sa.khopesh.com
khop-blessed.sa.khopesh.com
khop-general.sa.khopesh.com
khop-sc-neighbors.sa.khopesh.com

But that server is still running SA 3.3.1, so this may be caused by
something that changed from 3.3.1 to 3.3.2.

-- 
Bowie

Re: Latest sa-update crashing sa-compile?

Posted by Daniel McDonald <da...@austinenergy.com>.
On 8/15/11 9:15 AM, "Michael Scheidell" <mi...@secnap.com>
wrote:

>    On 8/15/11 10:13 AM, Michael Scheidell wrote:
>>   On 8/15/11 10:07 AM, Daniel McDonald wrote:
>>> 
>>>  
>>  mine too.  running sa-update again(just now) picks up a new build.
>>  interesting, spamassassin --lint didn't pick anything up.
>>  
>>  also note, 'scanner2.c' is a blank file, 0 bytes\
>>  
>  
>  didn't help:  (tz is CEST)
>  
>  you also use sought_rules?

Yes, I download the sought.rules.yerp.org channel.

>  
>   sa-compile
>  Aug 15 16:11:10.524 [56726] info: generic: base extraction starting. this can
> take a while...
>  Aug 15 16:11:10.525 [56726] info: generic: extracting from rules of type
> body_0
>  100% 
> [=============================================================================
> ==================] 7379.18 rules/sec 00m00s DONE
>  100% 
> [=============================================================================
> ==================]  57.19 bases/sec 02m18s DONE
>  Aug 15 16:13:29.565 [56726] info: body_0: 5403 base strings extracted in 139
> seconds
>  cd /tmp/.spamassassin56726Bqzzg8tmp
>  cd Mail-SpamAssassin-CompiledRegexps-body_0
>  re2c -i -b -o scanner1.c scanner1.re
>  re2c -i -b -o scanner2.c scanner2.re
>  re2c: error: line 172, column 2: unterminated string constant (missing ")
>  command failed: exit 1
>  
>  
>>  
>>  
>>

Re: Latest sa-update crashing sa-compile?

Posted by Michael Scheidell <mi...@secnap.com>.
On 8/15/11 10:13 AM, Michael Scheidell wrote:
> On 8/15/11 10:07 AM, Daniel McDonald wrote:
>>
> mine too.  running sa-update again(just now) picks up a new build.
> interesting, spamassassin --lint didn't pick anything up.
>
> also note, 'scanner2.c' is a blank file, 0 bytes\

didn't help:  (tz is CEST)

you also use sought_rules?

  sa-compile
Aug 15 16:11:10.524 [56726] info: generic: base extraction starting. 
this can take a while...
Aug 15 16:11:10.525 [56726] info: generic: extracting from rules of type 
body_0
100% 
[===============================================================================================] 
7379.18 rules/sec 00m00s DONE
100% 
[===============================================================================================]  
57.19 bases/sec 02m18s DONE
Aug 15 16:13:29.565 [56726] info: body_0: 5403 base strings extracted in 
139 seconds
cd /tmp/.spamassassin56726Bqzzg8tmp
cd Mail-SpamAssassin-CompiledRegexps-body_0
re2c -i -b -o scanner1.c scanner1.re
re2c -i -b -o scanner2.c scanner2.re
re2c: error: line 172, column 2: unterminated string constant (missing ")
command failed: exit 1

>
>
> -- 
> Michael Scheidell, CTO
> o: 561-999-5000
> d: 561-948-2259
> >*| *SECNAP Network Security Corporation
>
>     * Best Mobile Solutions Product of 2011
>     * Best Intrusion Prevention Product
>     * Hot Company Finalist 2011
>     * Best Email Security Product
>     * Certified SNORT Integrator
>
>
> ------------------------------------------------------------------------
>
> This email has been scanned and certified safe by SpammerTrap®.
> For Information please see http://www.secnap.com/products/spammertrap/
>
> ------------------------------------------------------------------------
>


-- 
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
 >*| *SECNAP Network Security Corporation

    * Best Mobile Solutions Product of 2011
    * Best Intrusion Prevention Product
    * Hot Company Finalist 2011
    * Best Email Security Product
    * Certified SNORT Integrator


______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________

Re: Latest sa-update crashing sa-compile?

Posted by Michael Scheidell <mi...@secnap.com>.
On 8/15/11 10:07 AM, Daniel McDonald wrote:
> I just noticed that my cron-job for sa-update/sa-compile has crashed 
> over the weekend.
>
> Spamassassin lints fine, but sa-compile fails:
> Aug 15 08:59:42.970 [469] info: generic: base extraction starting. 
> this can take a while...
> Aug 15 08:59:42.970 [469] info: generic: extracting from rules of type 
> body_0
> 100% [===========================================] 300.45 rules/sec 
> 00m05s DONE
> 100% [===========================================]  92.85 bases/sec 
> 00m36s DONE
> Aug 15 09:00:25.846 [469] info: body_0: 1838 base strings extracted in 
> 43 seconds
> cd /tmp/.spamassassin469X5iW4Ytmp
> cd Mail-SpamAssassin-CompiledRegexps-body_0
> re2c -i -b -o scanner1.c scanner1.re
> re2c -i -b -o scanner2.c scanner2.re
> re2c: error: line 194, column 2: unterminated string constant (missing ")
mine too.  running sa-update again(just now) picks up a new build.
interesting, spamassassin --lint didn't pick anything up.

also note, 'scanner2.c' is a blank file, 0 bytes



-- 
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
 >*| *SECNAP Network Security Corporation

    * Best Mobile Solutions Product of 2011
    * Best Intrusion Prevention Product
    * Hot Company Finalist 2011
    * Best Email Security Product
    * Certified SNORT Integrator


______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________

Re: Latest sa-update crashing sa-compile?

Posted by Noel Butler <no...@ausics.net>.
On Mon, 2011-08-15 at 16:34 -0400, Michael Scheidell wrote:


> > I just did an sa-update and the problem didn't go away.
> >
> > I'm running trunk (3.4.0) updated a couple days ago.
> >
> not fixed yet.
> 
> re2c: error: line 154, column 2: unterminated string constant (missing ")
> command failed: exit 1
> mx1#
> 
> 
> > I'm going to remove sought for now.
> >
> 
> 

Seeing that here still as well in 3.3.2

Re: Latest sa-update crashing sa-compile?

Posted by Michael Scheidell <mi...@secnap.com>.
On 8/15/11 12:08 PM, darxus@chaosreigns.com wrote:
> On 08/15, Daniel McDonald wrote:
>>     re2c: error: line 194, column 2: unterminated string constant (missing ")
> Yup, it's a sought rule.  Opened a bug:
> https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6649
>
> Thanks for posting this so I knew it wasn't a local problem.
>
> The problematic rule is __SEEK_4CZTNZ, and it looks very much like the
> problem is a newline in a string where there isn't allowed to be one.
>
>
> I just did an sa-update and the problem didn't go away.
>
> I'm running trunk (3.4.0) updated a couple days ago.
>
not fixed yet.

re2c: error: line 154, column 2: unterminated string constant (missing ")
command failed: exit 1
mx1#


> I'm going to remove sought for now.
>


-- 
Michael Scheidell, CTO
o: 561-999-5000
d: 561-948-2259
 >*| *SECNAP Network Security Corporation

    * Best Mobile Solutions Product of 2011
    * Best Intrusion Prevention Product
    * Hot Company Finalist 2011
    * Best Email Security Product
    * Certified SNORT Integrator

______________________________________________________________________
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.secnap.com/products/spammertrap/
______________________________________________________________________

Re: Latest sa-update crashing sa-compile?

Posted by da...@chaosreigns.com.
On 08/15, Daniel McDonald wrote:
>    re2c: error: line 194, column 2: unterminated string constant (missing ")

Yup, it's a sought rule.  Opened a bug:
https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6649

Thanks for posting this so I knew it wasn't a local problem.

The problematic rule is __SEEK_4CZTNZ, and it looks very much like the
problem is a newline in a string where there isn't allowed to be one.


I just did an sa-update and the problem didn't go away.

I'm running trunk (3.4.0) updated a couple days ago.


I'm going to remove sought for now.

-- 
"It's never too late to panic."
http://www.ChaosReigns.com