You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Jacob Lauritzen (Jira)" <ji...@apache.org> on 2021/04/27 09:01:00 UTC
[jira] [Created] (LUCENE-9939) Proper ASCII folding of Danish/Norwegian characters Ø, Å
Jacob Lauritzen created LUCENE-9939:
---------------------------------------
Summary: Proper ASCII folding of Danish/Norwegian characters Ø, Å
Key: LUCENE-9939
URL: https://issues.apache.org/jira/browse/LUCENE-9939
Project: Lucene - Core
Issue Type: Improvement
Components: modules/analysis
Reporter: Jacob Lauritzen
The current version of the ASCIIFoldingFilter sets Å, å to A, a and Ø, ø to O, o which I believe is incorrect.
Å was added by Norway as a replacement for the Aa (which is mapped to aa in the AsciiFoldingFilter) in 1917 and by Denmark in 1948. Aa is still used in a lot of names (as an example the second largest city in Denmark was originally named Aarhus, renamed to Århus in 1948 and named back to AArhus in 2010 for internationalization purposes).
The story of Ø is similar. It's equivalent to Œ (which is mapped to oe), not ö (which is mapped to o) and is generally mapped to oe in ascii text.
The third Danish character Æ is already properly mapped to AE.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org