[jira] [Created] (LUCENE-6392) Add offset limit to Highlighter's TokenStreamFromTermVector

["David Smiley (JIRA)" <ji...@apache.org>]

David Smiley created LUCENE-6392:
------------------------------------

             Summary: Add offset limit to Highlighter's TokenStreamFromTermVector
                 Key: LUCENE-6392
                 URL: https://issues.apache.org/jira/browse/LUCENE-6392
             Project: Lucene - Core
          Issue Type: Improvement
          Components: modules/highlighter
            Reporter: David Smiley
            Assignee: David Smiley
             Fix For: 5.2


The Highlighter's TokenStreamFromTermVector utility, typically accessed via TokenSources, should have the ability to filter out tokens beyond a configured offset. There is a TODO there already, and this issue addresses it.  New methods in TokenSources now propagate a limit.

This patch also includes some memory saving optimizations, to be described shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org