You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Jim Ferenczi (JIRA)" <ji...@apache.org> on 2018/04/12 18:41:00 UTC

[jira] [Created] (LUCENE-8250) Should FilteringTokenFilter handle positionLength

Jim Ferenczi created LUCENE-8250:
------------------------------------

             Summary: Should FilteringTokenFilter handle positionLength
                 Key: LUCENE-8250
                 URL: https://issues.apache.org/jira/browse/LUCENE-8250
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Jim Ferenczi


FilteringTokenFilter does not handle the position length graph attribute when removing a token from the stream. This doesn't work well with graph token stream that sets position length since removing a token from the stream can invalidate the position length set on the previous tokens. 
This issue was first discussed in https://issues.apache.org/jira/browse/LUCENE-4065 but it has a different purpose which is why I am opening a new issue here.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org