[jira] [Commented] (STANBOL-321) Named Entity detection engine should better deal with hyphenated text

["Ayeshmantha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STANBOL-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687824#comment-16687824 ] 

Ayeshmantha commented on STANBOL-321:
-------------------------------------

Hi [~rafaharo] 

Is anyone looking at this

> Named Entity detection engine should better deal with hyphenated text
> ---------------------------------------------------------------------
>
>                 Key: STANBOL-321
>                 URL: https://issues.apache.org/jira/browse/STANBOL-321
>             Project: Stanbol
>          Issue Type: Improvement
>          Components: Enhancement Engines
>            Reporter: Olivier Grisel
>            Assignee: Rafa Haro
>            Priority: Major
>
> We need some pre-processing to make it easier for OpenNLP to deal with hyphens, for instance this is an example of a real PDF:
> Sparse RBMs and sparse auto-encoders
> (RBM, SAE): In some of our experiments, we
> train sparse RBMs (Hinton et al., 2006) and
> sparse auto-encoders (Ranzato et al., 2007; Ben-
> gio et al., 2006), both using a logistic sigmoid non-
> linearity g(W x + b). These algorithms yield a set
> of weights W and biases b. To obtain the dictio-
> nary, D, we simply discard the biases and take
> D = W ⊤ , then normalize the columns of D.
> The current implementation return a TextAnnotation with entity-type = Person for the mention "Ben -" (which is then matched to "Ben Stiller" :P).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)