[jira] [Updated] (LUCENE-3455) All Analysis Consumers should use reusableTokenStream

["Chris Male (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/LUCENE-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Male updated LUCENE-3455:
-------------------------------

    Attachment: LUCENE-3455-test-consumers.patch

Patch which converts all test consumers over to using reusableTokenStream.

Included is a fix for PatternAnalyzer, where I had missed re-creating the Matcher which prevented reuse.

I'm going to commit this shortly and then attack production code.

> All Analysis Consumers should use reusableTokenStream
> -----------------------------------------------------
>
>                 Key: LUCENE-3455
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3455
>             Project: Lucene - Java
>          Issue Type: Sub-task
>          Components: modules/analysis
>            Reporter: Chris Male
>         Attachments: LUCENE-3455-test-consumers.patch
>
>
> With Analyzer now using TokenStreamComponents, theres no reason for Analysis consumers to use tokenStream() (it just gives bad performance).  Consequently all consumers will be moved over to using reusableTokenStream().  The only challenge here is that reusableTokenStream throws an IOException which many consumers are not rigged to deal with.
> Once all consumers have been moved, we can rename reusableTokenStream() back to tokenStream().

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org