You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@lucene.apache.org by "Tomoko Uchida (Jira)" <ji...@apache.org> on 2022/04/04 10:55:00 UTC

[jira] [Created] (LUCENE-10497) Unify "Token" interface in Kuromoji and Nori

Tomoko Uchida created LUCENE-10497:
--------------------------------------

             Summary: Unify "Token" interface in Kuromoji and Nori
                 Key: LUCENE-10497
                 URL: https://issues.apache.org/jira/browse/LUCENE-10497
             Project: Lucene - Core
          Issue Type: Sub-task
            Reporter: Tomoko Uchida


"Token" classes are the output of the viterbi algorithm in kuromoji and nori, and its implementation is slightly different between them (Nori's Token class looks more expressive or extendable).

To proceed [LUCENE-10493], I think we need the unified "Token" class or at least a common interface for it. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org