You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ofbiz.apache.org by "mz4wheeler (Created) (JIRA)" <ji...@apache.org> on 2011/10/31 05:16:32 UTC

[jira] [Created] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Search using Russian word (maybe others) causes distortion and failed product search
------------------------------------------------------------------------------------

                 Key: OFBIZ-4535
                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
             Project: OFBiz
          Issue Type: Bug
          Components: specialpurpose/ecommerce
    Affects Versions: Release 09.04.01, SVN trunk
         Environment: Ubuntu and others.
            Reporter: mz4wheeler


NOTE: The following post contains UTF8 characters.

After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:


ofbiz=# select * from product_keyword where keyword = 'игроков';
   product_id    | keyword | relevancy_weight (trimmed)
-----------------+---------+-----------------
 DVDMV-ADVANGYM  | игроков |                1 

However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"

Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.

This may affect other languages, which I haven't tested.

I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "mz4wheeler (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141256#comment-13141256 ] 

mz4wheeler commented on OFBIZ-4535:
-----------------------------------

Happens in other languages as well.
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "mz4wheeler (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148274#comment-13148274 ] 

mz4wheeler commented on OFBIZ-4535:
-----------------------------------

I loaded the stock 11.04 branch, and this problem does NOT occur.
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "mz4wheeler (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149177#comment-13149177 ] 

mz4wheeler commented on OFBIZ-4535:
-----------------------------------

Hey Jacques.  Try posting 'игроков' into the ecommerce search of the current trunk.  It returns 'Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²' not found.  If you post it to the 9.04 search, or branch 11.04, it returns 'игроков' not found.


                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "Jacques Le Roux (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221553#comment-13221553 ] 

Jacques Le Roux commented on OFBIZ-4535:
----------------------------------------

Hi Uwe,

Thanks for your help. From description it seems only Release 09.04.01 and trunk are touched. This could help to track the issue. Because it works on 09.04 and the culprit commit must be between (also 11.04 work(s/d) this could also foster to track). For now it's not a priority for me, sorry...
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Issue Comment Edited] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "Jacques Le Roux (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221553#comment-13221553 ] 

Jacques Le Roux edited comment on OFBIZ-4535 at 3/3/12 11:36 AM:
-----------------------------------------------------------------

==== EDIT ====
Hi Uwe,

Thanks for your help. From description it seems only Release 09.04.01 and trunk are touched. This could help to track the issue. Because it works on 09.04 and the culprit commit must be between (also 11.04 work(s/d) this could foster tracking). For now it's not a priority for me, sorry...
                
      was (Author: jacques.le.roux):
    Hi Uwe,

Thanks for your help. From description it seems only Release 09.04.01 and trunk are touched. This could help to track the issue. Because it works on 09.04 and the culprit commit must be between (also 11.04 work(s/d) this could also foster to track). For now it's not a priority for me, sorry...
                  
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "Uwe Allner (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220875#comment-13220875 ] 

Uwe Allner commented on OFBIZ-4535:
-----------------------------------

Yes, it occurs on trunk and demos as well. And not only in the search, but also e.g. when creating an address in the ecommerce application with german umlaut characters. It seems to me there is a general problem with encoding/decoding, even if the parameters are transported in the body of a POST request.
I checked all known means of fixing this: setting the SetCharacterEncodingFilter in the web.xml of my application (to UTF-8); the web page is UTF-8 encoded, the tomcat connector is set to UTF-8, the request is marked as UTF-8 and also the response comes as UTF-8.
Perhaps somewhere a double encoding is done; but I wasn't able to find it nor changing the behaviour of OFBiz in this regard in any way... :o(
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "Jacques Le Roux (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149141#comment-13149141 ] 

Jacques Le Roux commented on OFBIZ-4535:
----------------------------------------

Do you reproduce this on trunk and stable demos?
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (OFBIZ-4535) Search using Russian word (maybe others) causes distortion and failed product search

Posted by "mz4wheeler (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OFBIZ-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142806#comment-13142806 ] 

mz4wheeler commented on OFBIZ-4535:
-----------------------------------

OK:  I discovered that this used to work with the original 9.04.  During the recent updates, this UTF8 search broke.
                
> Search using Russian word (maybe others) causes distortion and failed product search
> ------------------------------------------------------------------------------------
>
>                 Key: OFBIZ-4535
>                 URL: https://issues.apache.org/jira/browse/OFBIZ-4535
>             Project: OFBiz
>          Issue Type: Bug
>          Components: specialpurpose/ecommerce
>    Affects Versions: Release 09.04.01, SVN trunk
>         Environment: Ubuntu and others.
>            Reporter: mz4wheeler
>
> NOTE: The following post contains UTF8 characters.
> After rebuilding keywords in a UTF8 database (postgres) and searching a UTF8 browser (chrome), the Russian phrase is correctly present in the database, as follows:
> ofbiz=# select * from product_keyword where keyword = 'игроков';
>    product_id    | keyword | relevancy_weight (trimmed)
> -----------------+---------+-----------------
>  DVDMV-ADVANGYM  | игроков |                1 
> However, when pasting 'игроков' into ecommerce Search, the following is returned "Not Found"
> Keywords: "Ð¸Ð³Ñ Ð¾ÐºÐ¾Ð²", where any word matches, which distorts the search.
> This may affect other languages, which I haven't tested.
> I also tried the same search in 9.04 (demo) and trunk and it produces the same issue.  This means that multi-language product search is broken in OFBiz.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira