You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2023/06/20 12:26:23 UTC
[GitHub] [doris-thirdparty] airborne12 opened a new pull request, #92: [Fix](standard analyzer) change standard analyzer CJK tokenizer, align it to newest standard analzyer mode
airborne12 opened a new pull request, #92:
URL: https://github.com/apache/doris-thirdparty/pull/92
make standard analyzer like this:
origin text
```
陕西省西安市高新区创业大厦A座，我的手机号码是14243907889，this information is created automatically.
```
after tokenized
```
陕|西|省|西|安|市|高|新|区|创|业|大|厦|座|我|的|手|机|号|码|是|14243907889|邮|箱|是|474696115|qq.com|ip|是|113.444.556.777.222|小|数|2.2333|多|大|事|information|created|automatically|
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris-thirdparty] zzzxl1993 commented on pull request #92: [Fix](standard analyzer) change standard analyzer CJK tokenizer, align it to newest standard analzyer mode
Posted by "zzzxl1993 (via GitHub)" <gi...@apache.org>.
zzzxl1993 commented on PR #92:
URL: https://github.com/apache/doris-thirdparty/pull/92#issuecomment-1598883223
LGTM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org
[GitHub] [doris-thirdparty] xiaokang merged pull request #92: [Fix](standard analyzer) change standard analyzer CJK tokenizer, align it to newest standard analzyer mode
Posted by "xiaokang (via GitHub)" <gi...@apache.org>.
xiaokang merged PR #92:
URL: https://github.com/apache/doris-thirdparty/pull/92
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org