You are viewing a plain text version of this content. The canonical link for it is here.
Posted to modperl@perl.apache.org by Mithun Bhattacharya <in...@yahoo.com> on 2003/06/13 13:42:34 UTC
UTF-8 support [was : (Re: [mp2] make test fails with 1.99_10-dev sources on redhat)]
--- Stas Bekman <st...@stason.org> wrote:
> > My understanding is that setting locale to UTF8 makes it try to
> open
> > everything as a UTF8 document, but not everything is one. It
> causes
> > problems for Java and Konsole too apparently. It could simply be
> that
> > Perl's handlling of UTF8 is broken, but I didn't want UTF8 in the
> first
> > place so putting LANG back to what it was before seems like a
> reasonable
> > fix to me.
If I understand correctly most XML parsers support UTF-8 primarily. If
perl's UTF-8 support is broken in 5.8.0 doesnt that mean it will break
any mod_perl application which is handling XML's or UTF-8 data ? What
about Axkit etc ? Anyone facing problem handling UTF-8 data using 5.8.0
based mod_perl setup ?
Mithun
__________________________________
Do you Yahoo!?
Yahoo! Calendar - Free online calendar with sync to Outlook(TM).
http://calendar.yahoo.com
Re: UTF-8 support
Posted by Mithun Bhattacharya <in...@yahoo.com>.
I did a search for UTF-8 and locale at
http://www.xray.mpe.mpg.de/mailing-lists/perl5-porters/
In the past 2-3 months the only problem seems to be that regex doesnt
seem to work properly on UTF-8 input
[http://www.xray.mpe.mpg.de/cgi-bin/w3glimpse2html/perl5-porters/2003-05/msg00183.html?68#mfs]
and that RedHat 9.0 ships with a buggy maintenance snapshot of perl
5.8.x
[http://www.xray.mpe.mpg.de/mailing-lists/perl5-porters/2003-05/msg00352.html]
I think it means we better wait a while before making large scale
applications to manipulate UTF-8 data but I could possibly be wrong.
Also ofcourse dont develop applications using RedHat 9.0's perl :).
Mithun
--- Stas Bekman <st...@stason.org> wrote:
> To second Perrin, 5.8.0's UTF8 support is not broken. From what I was
>
> following on the p5p, 5.8.0 had some minor issues, but 5.8.1 which
> will be
> released really soon now (my guess: July at OSCon) have them (all?)
> sorted
> out. You may want to browse p5p archives and rt.perl.org to see what
> UTF8
> problems were if any and whether they were resolved. If you find
> something
> that would be of interest to other readers, please post a summary
> here.
__________________________________
Do you Yahoo!?
SBC Yahoo! DSL - Now only $29.95 per month!
http://sbc.yahoo.com
Re: UTF-8 support [was : (Re: [mp2] make test fails with 1.99_10-dev
sources on redhat)]
Posted by Stas Bekman <st...@stason.org>.
Perrin Harkins wrote:
> Mithun Bhattacharya wrote:
>
>> If
>> perl's UTF-8 support is broken in 5.8.0 doesnt that mean it will break
>> any mod_perl application which is handling XML's or UTF-8 data ?
>
>
> I didn't say it was broken. I don't really know if it is. What I do
> know is that some documents, including CPAN modules, are not UTF8
> compliant, and opening them as UTF8 gives mysterious errors and test
> failures. Remember, this locale setting is a recent change. I doubt
> that chaning it back to what it was in Red Hat 7.3 will impact XML parsing.
To second Perrin, 5.8.0's UTF8 support is not broken. From what I was
following on the p5p, 5.8.0 had some minor issues, but 5.8.1 which will be
released really soon now (my guess: July at OSCon) have them (all?) sorted
out. You may want to browse p5p archives and rt.perl.org to see what UTF8
problems were if any and whether they were resolved. If you find something
that would be of interest to other readers, please post a summary here.
__________________________________________________________________
Stas Bekman JAm_pH ------> Just Another mod_perl Hacker
http://stason.org/ mod_perl Guide ---> http://perl.apache.org
mailto:stas@stason.org http://use.perl.org http://apacheweek.com
http://modperlbook.org http://apache.org http://ticketmaster.com
Re: UTF-8 support [was : (Re: [mp2] make test fails with 1.99_10-dev
sources on redhat)]
Posted by Perrin Harkins <pe...@elem.com>.
Mithun Bhattacharya wrote:
> If
> perl's UTF-8 support is broken in 5.8.0 doesnt that mean it will break
> any mod_perl application which is handling XML's or UTF-8 data ?
I didn't say it was broken. I don't really know if it is. What I do
know is that some documents, including CPAN modules, are not UTF8
compliant, and opening them as UTF8 gives mysterious errors and test
failures. Remember, this locale setting is a recent change. I doubt
that chaning it back to what it was in Red Hat 7.3 will impact XML parsing.
- Perrin