You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hivemall.apache.org by GitBox <gi...@apache.org> on 2021/04/21 14:38:05 UTC

[GitHub] [incubator-hivemall] myui opened a new pull request #235: [HIVEMALL-305] Kuromoji Japanese tokenizer with Neologd dictionary

myui opened a new pull request #235:
URL: https://github.com/apache/incubator-hivemall/pull/235


   ## What changes were proposed in this pull request?
   
   Add tokenize_ja_neologd UDF that uses Neologd dictionary for Kuromoji tokenization.
   
   ## What type of PR is it?
   
   Feature
   
   ## What is the Jira issue?
   
   https://issues.apache.org/jira/browse/HIVEMALL-305
   
   ## How was this patch tested?
   
   unit tests and manual tests on EMR
   
   ## How to use this feature?
   
   ```sql
   
   ```
   
   ## Checklist
   
   - [x] Did you apply source code formatter, i.e., `./bin/format_code.sh`, for your commit?
   - [x] Did you run system tests on Hive (or Spark)?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-hivemall] asfgit closed pull request #235: [HIVEMALL-305] Kuromoji Japanese tokenizer with Neologd dictionary

Posted by GitBox <gi...@apache.org>.

asfgit closed pull request #235:
URL: https://github.com/apache/incubator-hivemall/pull/235


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org