[jira] [Created] (LUCENE-5464) Put shared rules (and, separately, macros) into files to be included into StandardTokenizerImpl.jflex and UAX29URLEmailTokenizerImpl.jflex

["Steve Rowe (JIRA)" <ji...@apache.org>]

Steve Rowe created LUCENE-5464:
----------------------------------

             Summary: Put shared rules (and, separately, macros) into files to be included into StandardTokenizerImpl.jflex and UAX29URLEmailTokenizerImpl.jflex
                 Key: LUCENE-5464
                 URL: https://issues.apache.org/jira/browse/LUCENE-5464
             Project: Lucene - Core
          Issue Type: Improvement
          Components: modules/analysis
            Reporter: Steve Rowe
            Assignee: Steve Rowe
            Priority: Minor


The JFlex scanner specifications for StandardTokenizer and UAX29URLEmailTokenizer share macros and rules.

As of the JFlex 1.5 release, the {{%include}} directive can be used in the rules section, in addition to the macros section.

The shared macros and rules should be pulled out into files which are {{%include}}'d into the two scanner specifications.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org