You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2013/03/02 02:47:12 UTC
[jira] [Commented] (LUCENE-4810) Positions are incremented for each
ngram in EdgeNGramTokenFilter
[ https://issues.apache.org/jira/browse/LUCENE-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13591198#comment-13591198 ]
Robert Muir commented on LUCENE-4810:
-------------------------------------
At a glance I think I like the idea myself. I don't like tokenfilters that 'retokenize' by changing up the positions, i think it causes all kinds of havoc.
Instead with this patch, it simplifies what this filter is doing conceptually: for each word, all of its prefixes are added as synonyms.
> Positions are incremented for each ngram in EdgeNGramTokenFilter
> ----------------------------------------------------------------
>
> Key: LUCENE-4810
> URL: https://issues.apache.org/jira/browse/LUCENE-4810
> Project: Lucene - Core
> Issue Type: Bug
> Components: modules/analysis
> Reporter: Walter Underwood
> Attachments: LUCENE-4810.diff
>
>
> Edge ngrams should be like synonyms, with all the ngrams generated from a token having the same position as that original token. The current code increments position.
> For the text "molecular biology", the query "mol bio" should match as a phrase in neighboring positions. It does not.
> You can see this in the Analysis page in the admin UI.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org