You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gayathri Murali (JIRA)" <ji...@apache.org> on 2016/03/04 03:31:40 UTC
[jira] [Commented] (SPARK-13629) Add binary toggle Param to
CountVectorizer
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179180#comment-15179180 ]
Gayathri Murali commented on SPARK-13629:
-----------------------------------------
[~josephkb] In the case of discrete probabilistic models in which this is most applicable, would the min_df and max_df thresholds change? or only the word count should be set to 0 or 1 depending on the value of binary?
> Add binary toggle Param to CountVectorizer
> ------------------------------------------
>
> Key: SPARK-13629
> URL: https://issues.apache.org/jira/browse/SPARK-13629
> Project: Spark
> Issue Type: New Feature
> Components: ML
> Reporter: Joseph K. Bradley
> Priority: Minor
>
> It would be handy to add a binary toggle Param to CountVectorizer, as in the scikit-learn one: [http://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.CountVectorizer.html]
> If set, then all non-zero counts will be set to 1.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org