[jira] [Created] (LUCENE-8344) TokenStreamToAutomaton doesn't ignore trailing posInc when preservePositionIncrements=false

["David Smiley (JIRA)" <ji...@apache.org>]

David Smiley created LUCENE-8344:
------------------------------------

             Summary: TokenStreamToAutomaton doesn't ignore trailing posInc when preservePositionIncrements=false
                 Key: LUCENE-8344
                 URL: https://issues.apache.org/jira/browse/LUCENE-8344
             Project: Lucene - Core
          Issue Type: Bug
          Components: modules/suggest
            Reporter: David Smiley


TokenStreamToAutomaton in Lucene core is used by the AnalyzingSuggester (incl. FuzzySuggester subclass ) and NRT Document Suggester and soon the SolrTextTagger.  It has a setting {{preservePositionIncrements}} defaulting to true.  If it's set to false (e.g. to ignore stopwords) and if there is a _trailing_ position increment greater than 1, TS2A will _still_ add position increments (holes) into the automata even though it was configured not to.

I'm filing this issue separate from LUCENE-8332 where I first found it.  The fix is very simple but I'm concerned about back-compat ramifications so I'm filing it separately.  I'll attach a patch to show the problem.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org