You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "twosom (via GitHub)" <gi...@apache.org> on 2025/07/20 06:36:51 UTC
[PR] feat(nori): add metadata support to Korean tokenizer [lucene]
twosom opened a new pull request, #14969:
URL: https://github.com/apache/lucene/pull/14969
### Description
## Summary
Adds metadata support to Nori Korean analyzer, allowing users to attach additional information to dictionary words.
## Changes
- Added `MetadataAttribute` interface and implementation
- Extended user dictionary format to support `word >> metadata` syntax
- Preserves metadata during compound word decomposition
- Maintains backward compatibility with existing dictionaries
## Example
**Dictionary:**
```
자바 >> computer language
엘라스틱서치 엘라스틱 서치 >> search engine
```
**Result:**
- `자바` → Term: "자바", Metadata: "computer language"
- `엘라스틱서치` → All decomposed terms ("엘라스틱서치", "엘라스틱", "서치") carry "search engine" metadata
Fixes #14940
<!--
If this is your first contribution to Lucene, please make sure you have reviewed the contribution guide.
https://github.com/apache/lucene/blob/main/CONTRIBUTING.md
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [PR] feat(nori): add metadata support to Korean tokenizer [lucene]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #14969:
URL: https://github.com/apache/lucene/pull/14969#issuecomment-3408720272
This PR has not had activity in the past 2 weeks, labeling it as stale. If the PR is waiting for review, notify the dev@lucene.apache.org list. Thank you for your contribution!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [PR] feat(nori): add metadata support to Korean tokenizer [lucene]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #14969:
URL: https://github.com/apache/lucene/pull/14969#issuecomment-3093587044
This PR does not have an entry in lucene/CHANGES.txt. Consider adding one. If the PR doesn't need a changelog entry, then add the skip-changelog label to it and you will stop receiving this reminder on future updates to the PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [PR] feat(nori): add metadata support to Korean tokenizer [lucene]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #14969:
URL: https://github.com/apache/lucene/pull/14969#issuecomment-6205315230
This PR has not had activity in the past 2 weeks, labeling it as stale. If the PR is waiting for review, notify the dev@lucene.apache.org list. Thank you for your contribution!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org
Re: [PR] feat(nori): add metadata support to Korean tokenizer [lucene]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #14969:
URL: https://github.com/apache/lucene/pull/14969#issuecomment-3148816264
This PR has not had activity in the past 2 weeks, labeling it as stale. If the PR is waiting for review, notify the dev@lucene.apache.org list. Thank you for your contribution!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org