You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/02/20 19:49:44 UTC
[jira] [Commented] (SPARK-14659) OneHotEncoder support drop first
category alphabetically in the encoded vector
[ https://issues.apache.org/jira/browse/SPARK-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875004#comment-15875004 ]
Apache Spark commented on SPARK-14659:
--------------------------------------
User 'actuaryzhang' has created a pull request for this issue:
https://github.com/apache/spark/pull/17005
> OneHotEncoder support drop first category alphabetically in the encoded vector
> -------------------------------------------------------------------------------
>
> Key: SPARK-14659
> URL: https://issues.apache.org/jira/browse/SPARK-14659
> Project: Spark
> Issue Type: Improvement
> Components: ML
> Reporter: Yanbo Liang
>
> R formula drop the first category alphabetically when encode string/category feature. Spark RFormula use OneHotEncoder to encode string/category feature into vector, but only supporting "dropLast" by string/category frequencies. This will cause SparkR produce different models compared with native R.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org