You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@opennlp.apache.org by "Martin Wunderlich (JIRA)" <ji...@apache.org> on 2014/03/01 11:34:19 UTC

[jira] [Created] (OPENNLP-660) Stoplist

Martin Wunderlich created OPENNLP-660:
-----------------------------------------

             Summary: Stoplist
                 Key: OPENNLP-660
                 URL: https://issues.apache.org/jira/browse/OPENNLP-660
             Project: OpenNLP
          Issue Type: New Feature
          Components: Parser, Stemmer
    Affects Versions: tools-1.5.3
         Environment: all
            Reporter: Martin Wunderlich
            Priority: Minor


This feature request is for inclusion of list of stop words for various languages. These stop word lists can be used to reduce the noise caused by by frequent but irrelevant words, e.g. when tokenizing texts. The list could be a simple list of words for a first iteration, but could also include multi-stopwords, which will apply to n-grams (i.e. a word in the list will serve to "stop" a multi-word n-gram). 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)