identifier n-gram tokenizer

[Michal Hlavac <hl...@hlavki.eu>]

Hello,

I published some token filters that can be used to tokenize some kind of identifiers into punctation delimited n-grams (e.g. ip address).
I think it needs some optimization, but it works for now.

https://github.com/hlavki/lucene-analyzers

You can find example of usage in unit test:
https://github.com/hlavki/lucene-analyzers/blob/master/src/test/java/eu/hlavki/lucene/analysis/identifier/IdentifierNGramFilterTest.java

m.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org