You are viewing a plain text version of this content. The canonical link for it is here.

Posted to pylucene-dev@lucene.apache.org by Marc Jeurissen <ma...@uantwerpen.be> on 2020/03/19 10:12:36 UTC

Tokenizer

Pylucene version: 8.1.1

Hi all,

When you have a custom tokenizer (class CustomTokenizer(PythonTokenizer)), you don’t seem to be able to override any method besides incrementToken (so not end, reset, close).

Is this correct?

Thank you very much



Met vriendelijke groeten,
Marc Jeurissen

Bibliotheek UAntwerpen
Stadscampus – Ve35.303
Venusstraat 35 – 2000 Antwerpen
marc.jeurissen@uantwerpen.be
T +32 3 265 49 71