You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Benny Pedersen <me...@junc.eu> on 2021/08/12 02:03:24 UTC

spamassassin 3.4.5 wide chars

https://bugs.gentoo.org/807781

is it solved in 3.4.6 ?

RE: spamassassin 3.4.5 wide chars

Posted by Lukasz Maik <Lu...@ricoh-europe.com>.
Thank you all for your best help.

I will investigate.

Kind Regards
Lukas
Ricoh Europe Holdings PLC is a company registered in England, under company number 06273215, with a registered office at 20 Triton Street, London, NW1 3BF. The UK business of Ricoh Europe Holdings PLC is operated by: (i) Ricoh Europe PLC, a company registered in England under company number 00720944, with a registered office at 20 Triton Street, London, NW1 3BF; (ii) Ricoh UK Limited, a company registered in England under company number 01271033, with a registered office at Ricoh House, 800 Pavilion Drive, Northampton, NN4 7YL; and (iii) Ricoh Capital Limited, a company registered in England under company number 03001351, with a registered office at 20 Triton Street, London, NW1 3BF Please consider the environment before printing this e-mail

RE: spamassassin 3.4.5 wide chars

Posted by Lukasz Maik <Lu...@ricoh-europe.com>.
Thank you all for your best help.

I will investigate.

Kind Regards
Lukas
Ricoh Europe Holdings PLC is a company registered in England, under company number 06273215, with a registered office at 20 Triton Street, London, NW1 3BF. The UK business of Ricoh Europe Holdings PLC is operated by: (i) Ricoh Europe PLC, a company registered in England under company number 00720944, with a registered office at 20 Triton Street, London, NW1 3BF; (ii) Ricoh UK Limited, a company registered in England under company number 01271033, with a registered office at Ricoh House, 800 Pavilion Drive, Northampton, NN4 7YL; and (iii) Ricoh Capital Limited, a company registered in England under company number 03001351, with a registered office at 20 Triton Street, London, NW1 3BF Please consider the environment before printing this e-mail

Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-08-12 04:55, Bill Cole wrote:
> On 2021-08-11 at 22:03:24 UTC-0400 (Thu, 12 Aug 2021 04:03:24 +0200)
> Benny Pedersen <me...@junc.eu>
> is rumored to have said:
> 
>> https://bugs.gentoo.org/807781
>> 
>> is it solved in 3.4.6 ?
> 
> That's not a SA bug report. It's a Gentoo bug report.
> 
> Fix your rules.

thanks for being friendly

Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-08-12 04:55, Bill Cole wrote:
> On 2021-08-11 at 22:03:24 UTC-0400 (Thu, 12 Aug 2021 04:03:24 +0200)
> Benny Pedersen <me...@junc.eu>
> is rumored to have said:
> 
>> https://bugs.gentoo.org/807781
>> 
>> is it solved in 3.4.6 ?
> 
> That's not a SA bug report. It's a Gentoo bug report.
> 
> Fix your rules.

thanks for being friendly

Re: spamassassin 3.4.5 wide chars

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2021-08-11 at 22:03:24 UTC-0400 (Thu, 12 Aug 2021 04:03:24 +0200)
Benny Pedersen <me...@junc.eu>
is rumored to have said:

> https://bugs.gentoo.org/807781
>
> is it solved in 3.4.6 ?

That's not a SA bug report. It's a Gentoo bug report.

Fix your rules.


-- 
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo and many *@billmail.scconsult.com addresses)
Not Currently Available For Hire

Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-08-12 15:56, Jared Hall wrote:

> It occurs to me that I had a weird sa-compile problem a couple of weeks
> ago that produced a similar error.  I ended up blowing out everything
> under the /var/lib/spamassassin/compiled/ folder to fix it.  Worked
> fine after that.

i have tryed this aswell today, did not resolve it here, imho 
spamassassin should not have wide charter problems anywhere okay its 
imho still just a warning, but it should make sense with error lines 
sa-compile says, does the problem come from that content is not mime 
safe in mime encodings so sometimes rules is diffrent charsats or just 
even difffrent encoding in same file

would it be possible to make rules encoding default so all rules is 
always same so it stable to decode for rules checking ?

another way would to be make anyspam content reencoded to unicode, for 
rule makers, this way spamassing can do the same on checking, just a 
tought why its hard to make stable :(

> 
> Another Thought,
> 
> -- Jared Hall

Re: spamassassin 3.4.5 wide chars

Posted by Jared Hall <ja...@jaredsec.com>.
Benny Pedersen wrote:
>
> https://bugs.gentoo.org/807781
>
> is it solved in 3.4.6 ?

It occurs to me that I had a weird sa-compile problem a couple of weeks
ago that produced a similar error.  I ended up blowing out everything
under the /var/lib/spamassassin/compiled/ folder to fix it.  Worked
fine after that.

Another Thought,

-- Jared Hall


Re: spamassassin 3.4.5 wide chars

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2021-08-11 at 22:03:24 UTC-0400 (Thu, 12 Aug 2021 04:03:24 +0200)
Benny Pedersen <me...@junc.eu>
is rumored to have said:

> https://bugs.gentoo.org/807781
>
> is it solved in 3.4.6 ?

That's not a SA bug report. It's a Gentoo bug report.

Fix your rules.


-- 
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo and many *@billmail.scconsult.com addresses)
Not Currently Available For Hire

Re: spamassassin 3.4.5 wide chars

Posted by Loren Wilton <lw...@earthlink.net>.
I don't recall your problem, but note that 3.4.6 was a very hasty update to 
3.4.5 to correct some problems that showed up with some rules a day or so 
after 3.4.5 was created. If things worked before 3.4.5 and fail in rules 
wiht 3.4.5, I'd suggest that 3.4.6 may be the correct solution.

        Loren


---
This email has been checked for viruses by AVG.
https://www.avg.com


Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-09-05 19:02, John Wilcock wrote:

>> https://bugs.gentoo.org/807781

> I've no idea what the origin of this issue is, just that it occurs for
> you with 3.4.5 and that it doesn't appear for me on 3.4.6.

we could compare perl modules ?, if you use gentoo its not that, but if 
its another distro not showing the problem i like to fully have that 
reported on above url

i know slackware 14.2 does not show the problem, i know its not perl 
version issue atleast, in that regard the problem is stable :=)

> I trust spamassassin sufficiently to unmask it; I've no idea why the
> gentoo package maintainer thinks it isn't stable-worthy.

i just wish minimal requirement was updated so atleast some of the 
problems could be solved, i know spamassassin runs on many diffrent 
os'es, but that should imho not allow for weekness, perl code should not 
give warning if its stable

and yes even the default rule set shows the problem here

is it normalise charset related ?, or maybe even unicode support ?

more info would be good if it is possible

Re: spamassassin 3.4.5 wide chars

Posted by John Wilcock <jo...@wilcock.fr>.
Le 03/09/2021 à 19:16, Benny Pedersen a écrit :

> On 2021-09-03 18:12, John Wilcock wrote:
>> FWIW, I see no warning with today's rules on SA 3.4.6 and perl 5.34 
>> on gentoo.
>>
>> Benny, why don't you simply upgrade to 3.4.6? Sure, it hasn't yet been
>> marked as stable by the gentoo maintainers, but it works perfectly.
>
> 3.4.6-r1 is masked unstable, so this is indeed fix perl 5.34 issue ?
>
> https://bugs.gentoo.org/807781


I've no idea what the origin of this issue is, just that it occurs for 
you with 3.4.5 and that it doesn't appear for me on 3.4.6.

I trust spamassassin sufficiently to unmask it; I've no idea why the 
gentoo package maintainer thinks it isn't stable-worthy.

-- 
John


Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-09-03 18:12, John Wilcock wrote:
> FWIW, I see no warning with today's rules on SA 3.4.6 and perl 5.34 on 
> gentoo.
> 
> Benny, why don't you simply upgrade to 3.4.6? Sure, it hasn't yet been
> marked as stable by the gentoo maintainers, but it works perfectly.

3.4.6-r1 is masked unstable, so this is indeed fix perl 5.34 issue ?

https://bugs.gentoo.org/807781

Re: spamassassin 3.4.5 wide chars

Posted by John Wilcock <jo...@wilcock.fr>.
FWIW, I see no warning with today's rules on SA 3.4.6 and perl 5.34 on 
gentoo.

Benny, why don't you simply upgrade to 3.4.6? Sure, it hasn't yet been 
marked as stable by the gentoo maintainers, but it works perfectly.

-- 
John

Le 03/09/2021 à 16:37, Benny Pedersen a écrit :
> On 2021-08-12 04:03, Benny Pedersen wrote:
>> https://bugs.gentoo.org/807781
>>
>> is it solved in 3.4.6 ?
>
> reply to myself if its matters, rule sets from current sa-update today 
> is now showing this wide charters warning
>
> step to reproduce in gentoo:
>
> sa-update
> sa-compile
>
> before sa-compile call re2c its shown 2 warning lines
>
> spamassassin version 3.4.5
> perl version 5.34
>
> from one of my friends with slackware 14.2 its not a problem with perl 
> 5.22
>
> slackware current have perl 5.34 aswell, but i dont use slackware :=)
>
> seems pmc members does not either
>
> spamassassin should be stable from perl 5.8 and upwards, but its not :/
>

Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-08-12 04:03, Benny Pedersen wrote:
> https://bugs.gentoo.org/807781
> 
> is it solved in 3.4.6 ?

reply to myself if its matters, rule sets from current sa-update today 
is now showing this wide charters warning

step to reproduce in gentoo:

sa-update
sa-compile

before sa-compile call re2c its shown 2 warning lines

spamassassin version 3.4.5
perl version 5.34

from one of my friends with slackware 14.2 its not a problem with perl 
5.22

slackware current have perl 5.34 aswell, but i dont use slackware :=)

seems pmc members does not either

spamassassin should be stable from perl 5.8 and upwards, but its not :/


Re: spamassassin 3.4.5 wide chars

Posted by Jared Hall <ja...@jaredsec.com>.
Benny Pedersen wrote:
>
> https://bugs.gentoo.org/807781
>
> is it solved in 3.4.6 ?

Don't know.  I took a look at the Gentoo SA package and it's pretty 
basic.  RE2C
is pretty mature as is PERL.  Hard to believe Gentoo would mess that 
up.  But...

I got this a few months back when I copied what I thought was a 
single-quoted
phrase, properly escaped it and all, only to find out the quote signs 
were some
Hungarian Goulash Unicode.

perl -ne 'print "$. $_" if m/[\x80-\xFF]/' <FILENAME.CF> can detect it.

Using some 3rd-party rulesets, like Heinlein's, can be problematic as 
well as
they have a lot of Unicode sprinkled throughout; the SA normalize_charset
conundrum.

A Thought,

-- Jared Hall








Re: spamassassin 3.4.5 wide chars

Posted by Benny Pedersen <me...@junc.eu>.
On 2021-08-12 04:03, Benny Pedersen wrote:
> https://bugs.gentoo.org/807781
> 
> is it solved in 3.4.6 ?

reply to myself if its matters, rule sets from current sa-update today 
is now showing this wide charters warning

step to reproduce in gentoo:

sa-update
sa-compile

before sa-compile call re2c its shown 2 warning lines

spamassassin version 3.4.5
perl version 5.34

from one of my friends with slackware 14.2 its not a problem with perl 
5.22

slackware current have perl 5.34 aswell, but i dont use slackware :=)

seems pmc members does not either

spamassassin should be stable from perl 5.8 and upwards, but its not :/