You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@opennlp.apache.org by Tri Nguyen <yt...@gmail.com> on 2011/11/07 08:22:10 UTC

How to recognize a token is punctuation

Hi,

Could someone guide me how to recognize a token is punctuation?

Regards,
Tri.

Re: How to recognize a token is punctuation

Posted by Jörn Kottmann <ko...@gmail.com>.

Hello,

You can use the POS Tagger and check for the detected part of speech.

Or you could use the tokenizer and sentence detector to search for a
punctuation character at the end of the sentence.

Jörn

On 11/7/11 8:22 AM, Tri Nguyen wrote:
> Hi,
>
> Could someone guide me how to recognize a token is punctuation?
>
> Regards,
> Tri.
>