You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/06/06 07:47:00 UTC

[jira] [Commented] (SPARK-15064) Locale support in StopWordsRemover

    [ https://issues.apache.org/jira/browse/SPARK-15064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502928#comment-16502928 ] 

Apache Spark commented on SPARK-15064:
--------------------------------------

User 'dongjinleekr' has created a pull request for this issue:
https://github.com/apache/spark/pull/21501

> Locale support in StopWordsRemover
> ----------------------------------
>
>                 Key: SPARK-15064
>                 URL: https://issues.apache.org/jira/browse/SPARK-15064
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML
>    Affects Versions: 2.0.0
>            Reporter: Xiangrui Meng
>            Priority: Major
>
> We support case insensitive filtering (default) in StopWordsRemover. However, case insensitive matching depends on the locale and region, which cannot be explicitly set in StopWordsRemover. We should consider adding this support in MLlib.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org