You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael Gaber (JIRA)" <ji...@apache.org> on 2011/05/17 10:33:47 UTC
[jira] [Created] (LUCENE-3110) ASCIIFoldingFilter wrongly folds
german Umlauts
ASCIIFoldingFilter wrongly folds german Umlauts
-----------------------------------------------
Key: LUCENE-3110
URL: https://issues.apache.org/jira/browse/LUCENE-3110
Project: Lucene - Java
Issue Type: Improvement
Components: modules/analysis
Affects Versions: 3.1
Reporter: Michael Gaber
the german umlauts are currently mapped as follows.
Ä/ä => A/a
Ö/ö => O/o
Ü/ü => U/u
the correct mapping would be
Ä/ä => Ae/ae
Ö/ö => Oe/oe
Ü/ü => Ue/ue
so the corresponding rows in the switch statement should be moved down to the ae/oe/ue positions.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (LUCENE-3110) ASCIIFoldingFilter wrongly folds
german Umlauts
Posted by "Steven Rowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steven Rowe resolved LUCENE-3110.
---------------------------------
Resolution: Won't Fix
See LUCENE-1696, where Robert Muir advocates using an ICU collation filter instead of locale-sensitive accent stripping.
> ASCIIFoldingFilter wrongly folds german Umlauts
> -----------------------------------------------
>
> Key: LUCENE-3110
> URL: https://issues.apache.org/jira/browse/LUCENE-3110
> Project: Lucene - Java
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 3.1
> Reporter: Michael Gaber
>
> the german umlauts are currently mapped as follows.
> Ä/ä => A/a
> Ö/ö => O/o
> Ü/ü => U/u
> the correct mapping would be
> Ä/ä => Ae/ae
> Ö/ö => Oe/oe
> Ü/ü => Ue/ue
> so the corresponding rows in the switch statement should be moved down to the ae/oe/ue positions.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3110) ASCIIFoldingFilter wrongly folds
german Umlauts
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034764#comment-13034764 ]
Robert Muir commented on LUCENE-3110:
-------------------------------------
another option, is to use the German2 stemmer from snowball, which is a variation on the german stemmer
designed to handle these cases.
If you use GermanAnalyzer in 3.1 it uses this stemmer by default.
> ASCIIFoldingFilter wrongly folds german Umlauts
> -----------------------------------------------
>
> Key: LUCENE-3110
> URL: https://issues.apache.org/jira/browse/LUCENE-3110
> Project: Lucene - Java
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 3.1
> Reporter: Michael Gaber
>
> the german umlauts are currently mapped as follows.
> Ä/ä => A/a
> Ö/ö => O/o
> Ü/ü => U/u
> the correct mapping would be
> Ä/ä => Ae/ae
> Ö/ö => Oe/oe
> Ü/ü => Ue/ue
> so the corresponding rows in the switch statement should be moved down to the ae/oe/ue positions.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (LUCENE-3110) ASCIIFoldingFilter wrongly folds
german Umlauts
Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13034709#comment-13034709 ]
Robert Muir commented on LUCENE-3110:
-------------------------------------
Hi,
these characters are not German umlauts. They are unicode characters used
by a number of languages. the purpose of ASCIIFolding is to do simple accent-stripping.
> ASCIIFoldingFilter wrongly folds german Umlauts
> -----------------------------------------------
>
> Key: LUCENE-3110
> URL: https://issues.apache.org/jira/browse/LUCENE-3110
> Project: Lucene - Java
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 3.1
> Reporter: Michael Gaber
>
> the german umlauts are currently mapped as follows.
> Ä/ä => A/a
> Ö/ö => O/o
> Ü/ü => U/u
> the correct mapping would be
> Ä/ä => Ae/ae
> Ö/ö => Oe/oe
> Ü/ü => Ue/ue
> so the corresponding rows in the switch statement should be moved down to the ae/oe/ue positions.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org