[jira] [Created] (LUCENE-4993) BeiderMorseFilter inserts tokens with positionIncrement=0, but ignores all custom attributes except OffsetAttribute

["Uwe Schindler (JIRA)" <ji...@apache.org>]

Uwe Schindler created LUCENE-4993:
-------------------------------------

             Summary: BeiderMorseFilter inserts tokens with positionIncrement=0, but ignores all custom attributes except OffsetAttribute
                 Key: LUCENE-4993
                 URL: https://issues.apache.org/jira/browse/LUCENE-4993
             Project: Lucene - Core
          Issue Type: Bug
          Components: modules/analysis
    Affects Versions: 4.3
            Reporter: Uwe Schindler
            Assignee: Uwe Schindler
            Priority: Trivial
             Fix For: 4.4


BeiderMorseFilter inserts sometimes additional phonetic tokens for the same source token. Currently it calls clearAttributes before doing this and sets the new token's term, positionIncrement=0 and the original offset.

This leads to problems if the TokenStream contains other attributes inserted before (like KeywordAttribute, FlagsAttribute,...). Those are all reverted to defaults for the inserted tokens.

The TokenFilter should remove the special case done for preserving offsets and instead to captureState() and restoreState().

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org