[jira] [Comment Edited] (SOLR-5152) EdgeNGramFilterFactory deletes token

["Sergey Urushkin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909324#comment-14909324 ] 

Sergey Urushkin edited comment on SOLR-5152 at 9/26/15 4:01 PM:
----------------------------------------------------------------

I've adapted Furkan's patch to solr 5.0.0 (it applies to 5.3.1 too). preserveOriginal works fine for me with 5.0.0.
Just one thing - since EdgeNGramFilterFactory doesn't update offsets anymore, ant throws an error about UpdateOffsets, so I simply removed this if-else block. After that solr compiles fine, but may be this part of code should be changed somehow smarter.
And thanks a lot, Furkan.


was (Author: urusha):
I've adapted patch to solr 5.0.0 (it applies to 5.3.1 too). preserveOriginal works fine for me with 5.0.0.
Just one thing - since EdgeNGramFilterFactory doesn't update offsets anymore, ant throws an error about UpdateOffsets, so I simply removed this if-else block. After that solr compiles fine, but may be this part of code should be changes somehow smarter.
And thanks a lot, Furkan.

> EdgeNGramFilterFactory deletes token
> ------------------------------------
>
>                 Key: SOLR-5152
>                 URL: https://issues.apache.org/jira/browse/SOLR-5152
>             Project: Solr
>          Issue Type: Improvement
>    Affects Versions: 4.4
>            Reporter: Christoph Lingg
>         Attachments: SOLR-5152-v5.0.0.patch, SOLR-5152.patch
>
>
> I am using EdgeNGramFilterFactory in my schema.xml
> {code:xml}<fieldType name="text" class="solr.TextField" positionIncrementGap="100">
>   <analyzer type="index">
>     <!-- ... -->
>     <filter class="solr.EdgeNGramFilterFactory" minGramSize="2" maxGramSize="10" side="front" />
>   </analyzer>
> </fieldType>{code}
> Some tokens in my index only consist of one character, let's say {{R}}. minGramSize is set to 2 and is bigger than the length of the token. I expected the NGramFilter to left {{R}} unchanged but in fact it is deleting the token.
> For my use case this interpretation is undesirable, and probably for most use cases too!?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org