You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@ctakes.apache.org by "James Joseph Masanz (JIRA)" <ji...@apache.org> on 2017/03/27 14:38:42 UTC

[jira] [Updated] (CTAKES-371) update PTB tokenization logic in fast dictionary module

     [ https://issues.apache.org/jira/browse/CTAKES-371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Joseph Masanz updated CTAKES-371:
---------------------------------------
    Fix Version/s:     (was: 3.2.3)
                   4.0.0

> update PTB tokenization logic in fast dictionary module
> -------------------------------------------------------
>
>                 Key: CTAKES-371
>                 URL: https://issues.apache.org/jira/browse/CTAKES-371
>             Project: cTAKES
>          Issue Type: Bug
>          Components: ctakes-dictionary-lookup
>    Affects Versions: 3.2.2
>            Reporter: britt fitch
>            Assignee: Sean Finan
>             Fix For: 4.0.0
>
>
> PTB tokenization logic is used in places like the tokenizer & dictionary building code. 
> For example, given “22q11.2 deletion syndrome”:
> PTB tokenizer: [22q11, .2, deletion, syndrome]
> Dictionary module:  [22q11, ., 2, deletion, syndrome]   
> (RareWordTermMapCreator.getTokens)
> Dictionary module should be updated to match PTB tokenization logic used elsewhere in ctakes.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)