You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@lenya.apache.org by Franz Ruebe <fr...@hotmail.com> on 2005/06/13 15:22:28 UTC
Garbage Character
Hi,
my env: lenya 1.2.3, tomcat 5.0.28, cocoon 2.1.7 on WinXP and suse linux
I have a problem with garbage characters in authoring (submit or publishing
confirmation-sites) and searching with Umlaute (äöü). This only occurs on
the linux machine when I call it with various browsers (firefox 1.0.4,
explorer 6.0, opera 5...). On the system itself testet with lynx (!),
searching with umlaute works.
I discovered the following things:
On the linux-machine "ü" is translated in that url-query :
lucene?queryString=%FC
on win:
lucene?queryString=%C3%BC
If I'm changing the queryString manually to e.g. %C3%BCber, search works.
In the source code of the "Do you really want to publish/deactivate"
delivered html-pages, the first line is
<?xml version="1.0" encoding="UTF-8"?>
This should'nt be, I assume. Beeing on both machine same this is not, so I
think not this is not the reason for the problem described above.
Any Ideas
Thanks in advance
Franz
_________________________________________________________________
MSN Hotmail. Anmelden und gewinnen! http://www.msn.de/email/webbased/ Ihre
Chance, eines von 10 T-Mobile MDA II zu gewinnen!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Paul Friedman <pf...@quoininc.com>.
I think that this is a known issue in Cocoon.
A quick search showed that there has been discussion about it since 2002
- but I couldn't see if there is a patch to Cocoon that resolves the
problem.
Until then put a "charset=UTF-8" in the mime-type of your serializer.
Glad I could help.
- Paul
Franz Ruebe wrote:
> Hi Paul,
>
> I read again my lenya/sitemap.xmap and just added your addition
> "charset=UTF-8" to the mime-type. Tataah!
>
> So question to developer: Is this a bug?
>
> Many thanks for helping.
>
> Franz
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> I read again my lenya/sitemap.xmap and just added your addition
> "charset=UTF-8" to the mime-type. Tataah!
>
> So question to developer: Is this a bug?
if it fixed your problem, then yes
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Paul,
thanks again for answering.
But this:
>publication-sitemap.xmap
doesn't fit in my configuration, because in these xmaps no serializers are
defined.
I read again my lenya/sitemap.xmap and just added your addition
"charset=UTF-8" to the mime-type. Tataah!
So question to developer: Is this a bug?
Many thanks for helping.
Franz
_________________________________________________________________
Machen Sie lästigen E-Mails ein Ende. MSN Hotmail mit Junk-Mail-Filter.
http://www.msn.de/antispam/prevention/junkmailfilter Jetzt kostenlos
anmelden!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Paul Friedman <pf...@quoininc.com>.
publication-sitemap.xmap
Franz Ruebe wrote:
> Hi Paul,
>
> thanks for your answer,
>
>> we had a number of issues with a garbage character appearing on our
>> pages and the <encoding>UTF-8</encoding> wasn't enough.
>>
>> I remember that we added
>>
>> <map:serializer
>> name="xml"
>> src="org.apache.cocoon.serialization.XMLSerializer"
>> mime-type="text/html; charset=UTF-8"
>>
>> in addition to the encoding tag to get rid of the garabage character
>> - note the addition of "charset=UTF-8" in the mime-type.
>
>
> In which file did you add this? sitemap.xmap, lucene.xmap...?
>
> Thanks in advance
>
> Franz
Re: Garbage Character
Posted by Paul Friedman <pf...@quoininc.com>.
publication-sitemap.xmap
Franz Ruebe wrote:
> Hi Paul,
>
> thanks for your answer,
>
>> we had a number of issues with a garbage character appearing on our
>> pages and the <encoding>UTF-8</encoding> wasn't enough.
>>
>> I remember that we added
>>
>> <map:serializer
>> name="xml"
>> src="org.apache.cocoon.serialization.XMLSerializer"
>> mime-type="text/html; charset=UTF-8"
>>
>> in addition to the encoding tag to get rid of the garabage character
>> - note the addition of "charset=UTF-8" in the mime-type.
>
>
> In which file did you add this? sitemap.xmap, lucene.xmap...?
>
> Thanks in advance
>
> Franz
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Paul,
thanks for your answer,
>we had a number of issues with a garbage character appearing on our pages
>and the <encoding>UTF-8</encoding> wasn't enough.
>
>I remember that we added
>
><map:serializer
> name="xml"
> src="org.apache.cocoon.serialization.XMLSerializer"
> mime-type="text/html; charset=UTF-8"
>
>in addition to the encoding tag to get rid of the garabage character - note
>the addition of "charset=UTF-8" in the mime-type.
In which file did you add this? sitemap.xmap, lucene.xmap...?
Thanks in advance
Franz
_________________________________________________________________
So einfach geht das. MSN Toolbar mit Pop-up-Blocker. http://toolbar.msn.de/
Jetzt kostenlos downloaden und gut ist!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Paul Friedman <pf...@quoininc.com>.
Hello all.
Please excuse if I come in mid-thread and chime in with something
totally off but . . .
we had a number of issues with a garbage character appearing on our
pages and the <encoding>UTF-8</encoding> wasn't enough.
I remember that we added
<map:serializer
name="xml"
src="org.apache.cocoon.serialization.XMLSerializer"
mime-type="text/html; charset=UTF-8"
in addition to the encoding tag to get rid of the garabage character -
note the addition of "charset=UTF-8" in the mime-type.
Hope that helps.
pax et bonum. p.
Franz Ruebe wrote:
> Hi Gregor,
>
> My lucene.xmap is already the new version...
> In all the publicated html sites is <META http-equiv="Content-Type"
> content="text/html; charset=UTF-8">, as well in the pages with the
> garbage characters.
> Because of only sites with form-elements beeing involved, I risk to
> assume a problem in a "pipeline for form-fields".
>
> Best regards
>
> Franz
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> thanks for your patience ;-)
no, thank you for helping to find bugs.
>> hmm, try adding accept-charset="utf-8" to your form, and make sure
>> form encoding is set to utf-8 in web.xml
>
>
> I just edited the sitemap.xmap and added charset=UTF-8 to the mime-type
> of the xhtml-serializer and now it works!
> Is this a bug (not kidding)?
it is, and i have just fixed it
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Gregor,
thanks for your patience ;-)
>hmm, try adding accept-charset="utf-8" to your form, and make sure form
>encoding is set to utf-8 in web.xml
I just edited the sitemap.xmap and added charset=UTF-8 to the mime-type of
the xhtml-serializer and now it works!
Is this a bug (not kidding)?
Best regards
Franz
_________________________________________________________________
Nicht lange suchen finden! MSN Suche. http://search.msn.de/ Jetzt testen!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> Because of only sites with form-elements beeing involved, I risk to
> assume a problem in a "pipeline for form-fields".
hmm, try adding accept-charset="utf-8" to your form, and make sure form
encoding is set to utf-8 in web.xml
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Gregor,
me again...
>http://svn.apache.org/viewcvs.cgi/lenya/branches/BRANCH_1_2_X/src/webapp/lenya/lucene.xmap?rev=160354&r1=56820&r2=160354&diff_format=h
My lucene.xmap is already the new version...
In all the publicated html sites is <META http-equiv="Content-Type"
content="text/html; charset=UTF-8">, as well in the pages with the garbage
characters.
Because of only sites with form-elements beeing involved, I risk to assume a
problem in a "pipeline for form-fields".
Best regards
Franz
_________________________________________________________________
Ungestört surfen. MSN Toolbar mit Pop-up-Blocker. http://toolbar.msn.de/
Jetzt kostenlos downloaden!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> So in this I looked first, but xml, xhtml and html serializers in there
> have already set <encoding>UTF-8</encoding>, so I thought there are some
> deeper (not obviously found) xmaps, which are "overwriting" these
> settings. Especially because of the problem beeing restricted to search
> and authoring.
you are right. i changed this on april 7:
http://svn.apache.org/viewcvs.cgi/lenya/branches/BRANCH_1_2_X/src/webapp/lenya/lucene.xmap?rev=160354&r1=56820&r2=160354&diff_format=h
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Gregor,
ok, I'm lazy, but not as half as you assume.
I should have mentioned that I read the old thread above this error and
already looked up the xmap-files I thought to be obviously the most
significant ones (as far as I understand...).
>the root sitemap.xmap which is in webapp/lenya/sitemap.xmap
So in this I looked first, but xml, xhtml and html serializers in there have
already set <encoding>UTF-8</encoding>, so I thought there are some deeper
(not obviously found) xmaps, which are "overwriting" these settings.
Especially because of the problem beeing restricted to search and authoring.
Best regards
Franz
_________________________________________________________________
Wenns mal schnell gehen soll. MSN Suche. http://search.msn.de/ Jetzt
kostenlos nutzen und keine Zeit mehr verlieren.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> Could you give me a hint in which files to change the serializers?
> (there are a lot of xmap-files)
the root sitemap.xmap which is in webapp/lenya/sitemap.xmap
> And should I change html and xhtml serializers?
yes
> By the way, is there any (graphical) description of the
> sitemap-architecture of lenya I've overseen?
> http://lenya.apache.org/1_2_x/tutorial/anatomy_of_the_pipeline.html
> gives an short introduction.
not that i know
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by Franz Ruebe <fr...@hotmail.com>.
Hi Gregor,
thanks for your fast answer,
>ahd the serializers should be set to utf-8
Could you give me a hint in which files to change the serializers? (there
are a lot of xmap-files)
And should I change html and xhtml serializers?
By the way, is there any (graphical) description of the sitemap-architecture
of lenya I've overseen?
http://lenya.apache.org/1_2_x/tutorial/anatomy_of_the_pipeline.html gives an
short introduction.
Thanks in advance
Franz
_________________________________________________________________
Nicht lange suchen finden! MSN Suche. http://search.msn.de/ Jetzt testen!
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org
Re: Garbage Character
Posted by "Gregor J. Rothfuss" <gr...@apache.org>.
Franz Ruebe wrote:
> I have a problem with garbage characters in authoring (submit or
> publishing confirmation-sites) and searching with Umlaute (äöü). This
> only occurs on the linux machine when I call it with various browsers
> (firefox 1.0.4, explorer 6.0, opera 5...). On the system itself testet
> with lynx (!), searching with umlaute works.
i think there are a few screens that are not correctly set to utf-8
encoding. all html pages should have
<meta content="application/xhtml+xml; charset=UTF-8"
http-equiv="Content-Type" />
or
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type" />
ahd the serializers should be set to utf-8
i believe this is the case in 1.2.4-dev (if not, it's a bug)
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@lenya.apache.org
For additional commands, e-mail: user-help@lenya.apache.org