You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "rmuir (via GitHub)" <gi...@apache.org> on 2024/03/28 14:35:09 UTC
[PR] Add RomanianNormalizationFilter [lucene]
rmuir opened a new pull request, #13233:
URL: https://github.com/apache/lucene/pull/13233
#12172 raised the issue of two different forms "in the wild" for Romanian:
* legacy ş/ţ/Ş/Ţ which uses a cedilla to "approximate" comma-below
* modern ș/ț/Ș/Ț which uses comma-below
We've fixed the stopwords, and fixed snowball stemmer, to complete the job we need a normalizer.
This allows the normalization to work correctly for various corner-cases:
* `Analyzer.normalize()` (normalizing the characters for e.g. wildcard searches)
* Users who build custom analyzer and don't want stemming
* Users who make use of stemExclusionSet and disable stemmer for certain words
I've also included a MIGRATE.txt for Romanian as a whole for 10.0, users should reindex Romanian documents.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [PR] Add RomanianNormalizationFilter [lucene]
Posted by "rmuir (via GitHub)" <gi...@apache.org>.
rmuir merged PR #13233:
URL: https://github.com/apache/lucene/pull/13233
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org