You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2014/03/04 18:06:21 UTC
[jira] [Commented] (LUCENE-5224)
org.apache.lucene.analysis.hunspell.HunspellDictionary should implement
ICONV and OCONV lines in the affix file
[ https://issues.apache.org/jira/browse/LUCENE-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919635#comment-13919635 ]
ASF subversion and git services commented on LUCENE-5224:
---------------------------------------------------------
Commit 1574135 from [~rcmuir] in branch 'dev/trunk'
[ https://svn.apache.org/r1574135 ]
LUCENE-5224: Add iconv, oconv, and ignore support to HunspellStemFilter
> org.apache.lucene.analysis.hunspell.HunspellDictionary should implement ICONV and OCONV lines in the affix file
> ---------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-5224
> URL: https://issues.apache.org/jira/browse/LUCENE-5224
> Project: Lucene - Core
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 4.0, 4.4
> Reporter: George Rhoten
> Assignee: Robert Muir
> Attachments: LUCENE-5224.patch, LUCENE-5224.patch, LUCENE-5224.patch
>
>
> There are some Hunspell dictionaries that need to emulate Unicode normalization and collation in order to get the correct stem of a word. The original Hunspell provides a way to do this with the ICONV and OCONV lines in the affix file. The Lucene HunspellDictionary ignores these lines right now.
> Please support these keys in the affix file.
> This bit of functionality is briefly described in the hunspell man page http://manpages.ubuntu.com/manpages/lucid/man4/hunspell.4.html
> This functionality is practically required in order to use a Korean dictionary because you want only some of the Jamos of a Hangul character (grapheme cluster) when using stemming. Other languages will find this to be helpful functionality.
> Here is an example for a .aff file:
> {code}
> ICONV 각 각
> ...
> OCONV 각 각
> {code}
> Here is the same example escaped.
> {code}
> ICONV \uAC01 \u1100\u1161\u11A8
> ...
> OCONV \u1100\u1161\u11A8 \uAC01
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org