You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/04/05 11:21:00 UTC
[jira] [Commented] (LUCENE-10497) Unify "Token" interface in Kuromoji and Nori
[ https://issues.apache.org/jira/browse/LUCENE-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517386#comment-17517386 ]
ASF subversion and git services commented on LUCENE-10497:
----------------------------------------------------------
Commit bb4a0dc19ba911ac488e3ea7d6fcb3b17a38832f in lucene's branch refs/heads/main from Tomoko Uchida
[ https://gitbox.apache.org/repos/asf?p=lucene.git;h=bb4a0dc19ba ]
LUCENE-10497: Add a base Token class to analysis-common (for kuromoji and nori) (#783)
> Unify "Token" interface in Kuromoji and Nori
> --------------------------------------------
>
> Key: LUCENE-10497
> URL: https://issues.apache.org/jira/browse/LUCENE-10497
> Project: Lucene - Core
> Issue Type: Sub-task
> Reporter: Tomoko Uchida
> Priority: Minor
> Time Spent: 20m
> Remaining Estimate: 0h
>
> "Token" classes are the output of the viterbi algorithm in kuromoji and nori, and its implementation is slightly different between them (Nori's Token class looks more expressive or extendable).
> To proceed [LUCENE-10493], I think we need the unified "Token" class or at least a common interface for it.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org