You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Karol Rybak <ka...@gmail.com> on 2007/06/26 09:34:46 UTC

Weird encoding problem

Hello, i have set up nutch to do some more testing, after indexing couple
thousand pages i tried to do some searching. Everything works fine, however
there's one problem, i cannot search using polish characters. I tried
searching for a query like "Materiały dydaktyczne" i got no results, and the
text in the search field changed into "MateriaÅ‚y dydaktyczne". Everything
else is fine when i search for "dydaktyczne" results show up and the
encoding is ok. Do you have any idea what could be wrong ?

Re: Weird encoding problem

Posted by Dawid Weiss <da...@cs.put.poznan.pl>.

Tomcat's Context should have URIEncoding="UTF-8" attribute. Search the Web for 
"tomcat URIEncoding" and you'll figure it out.

D.

Karol Rybak wrote:
> Hello, i have set up nutch to do some more testing, after indexing couple
> thousand pages i tried to do some searching. Everything works fine, however
> there's one problem, i cannot search using polish characters. I tried
> searching for a query like "Materiały dydaktyczne" i got no results, and 
> the
> text in the search field changed into "MateriaÅ‚y dydaktyczne". Everything
> else is fine when i search for "dydaktyczne" results show up and the
> encoding is ok. Do you have any idea what could be wrong ?

Re: Weird encoding problem

Posted by Enis Soztutar <en...@gmail.com>.

i suggest you first open the index with luke and check that the encoding 
is detected correct, and make a search from luke to see if you get any 
answers. Then you may invoke org.apache.nutch.searcher.Query to see if 
you query is parsed and translated correctly. Finally, you may check 
tomcat whether it uses utf-8 encoding.

Karol Rybak wrote:
> Hello, i have set up nutch to do some more testing, after indexing couple
> thousand pages i tried to do some searching. Everything works fine, 
> however
> there's one problem, i cannot search using polish characters. I tried
> searching for a query like "Materiały dydaktyczne" i got no results, 
> and the
> text in the search field changed into "MateriaÅ‚y dydaktyczne". 
> Everything
> else is fine when i search for "dydaktyczne" results show up and the
> encoding is ok. Do you have any idea what could be wrong ?