You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@opennlp.apache.org by "krickert (via GitHub)" <gi...@apache.org> on 2026/10/01 22:43:30 UTC

Re: [PR] OPENNLP-1934: Regex removal (6/10): Define the tokenizer character policy that replaces the alphanumeric pattern (opennlp)

krickert commented on PR #1349:
URL: https://github.com/apache/opennlp/pull/1349#issuecomment-5942159649

   This can wait for 3.x, but leaving open for now since it is ready. 
   
   The there's follow-up code I'll see about in another time, it deprecates the tokenizer's Pattern constructors instead of replacing them.  There's no rush in this, but it'll help performance and move us toward being 100% regex free.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opennlp.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org