You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Stanislaw Osinski (JIRA)" <ji...@apache.org> on 2007/07/26 15:14:40 UTC
[jira] Updated: (LUCENE-966) A faster JFlex-based replacement for
StandardAnalyzer
[ https://issues.apache.org/jira/browse/LUCENE-966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stanislaw Osinski updated LUCENE-966:
-------------------------------------
Attachment: jflex-analyzer-patch.txt
Here comes a somewhat rough (needing refactorings, see below) patch adding a JFlex-based repalcement for StandardAnalyzer called FastAnalyzer. A few comments:
* all tests from TestStandardAnalyzer pass
* tokenizer generation added to Ant build scripts
Because FastAnalyzer shares some code with StandardAnalyzer, it might be worthwhile to do some refactorings:
* have a common test for both analyzers (only if we want to keep them in sync)
* have a common superclass for FastFilter and StandardFilter
* have a common superclass for FastAnalyzer and StandardAnalyzer
> A faster JFlex-based replacement for StandardAnalyzer
> -----------------------------------------------------
>
> Key: LUCENE-966
> URL: https://issues.apache.org/jira/browse/LUCENE-966
> Project: Lucene - Java
> Issue Type: Improvement
> Components: Analysis
> Reporter: Stanislaw Osinski
> Fix For: 2.3
>
> Attachments: jflex-analyzer-patch.txt
>
>
> JFlex (http://www.jflex.de/) can be used to generate a faster (up to several times) replacement for StandardAnalyzer. Will add a patch and a simple benchmark code in a while.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org