You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (Commented) (JIRA)" <ji...@apache.org> on 2011/11/10 17:52:51 UTC
[jira] [Commented] (SOLR-2888) FSTSuggester should use utf8/utf32
order
[ https://issues.apache.org/jira/browse/SOLR-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147816#comment-13147816 ]
Robert Muir commented on SOLR-2888:
-----------------------------------
or is external sort dependent on this? :)
I would say one advantage of utf8 representation would be easier integration
with our other automaton stuff... its optimized for utf-8 and there is code
here and there that intertwines the two. this could be useful for potential
fuzzy matching (edit distances)
One disadvantage of utf-8 would be that if you use more than 128 buckets
it would cause the prefix byte to be plural... I think thats an ok limitation though?
> FSTSuggester should use utf8/utf32 order
> -----------------------------------------
>
> Key: SOLR-2888
> URL: https://issues.apache.org/jira/browse/SOLR-2888
> Project: Solr
> Issue Type: Improvement
> Components: spellchecker
> Reporter: Dawid Weiss
> Assignee: Dawid Weiss
> Fix For: 4.0
>
>
> For some reason it uses utf16 internally. Shouldn't make much of a difference, really.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org