You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Lochana Menikarachchi <lo...@gmail.com> on 2014/12/13 03:16:01 UTC
one hot encoding
Do we have one-hot encoding in spark MLLib 1.1.1 or 1.2.0 ? It wasn't
available in 1.1.0.
Thanks.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: one hot encoding
Posted by "smyee@yahoo.com.INVALID" <sm...@yahoo.com.INVALID>.
Sandy, will it be available to pyspark use too?
> On Dec 13, 2014, at 6:18 PM, Sandy Ryza <sa...@cloudera.com> wrote:
>
> Hi Lochana,
>
> We haven't yet added this in 1.2.
> https://issues.apache.org/jira/browse/SPARK-4081 tracks adding categorical
> feature indexing, which one-hot encoding can be built on.
> https://issues.apache.org/jira/browse/SPARK-1216 also tracks a version of
> this prior to the ML pipelines work.
>
> -Sandy
>
> On Fri, Dec 12, 2014 at 6:16 PM, Lochana Menikarachchi <lo...@gmail.com>
> wrote:
>>
>> Do we have one-hot encoding in spark MLLib 1.1.1 or 1.2.0 ? It wasn't
>> available in 1.1.0.
>> Thanks.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: one hot encoding
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Lochana,
We haven't yet added this in 1.2.
https://issues.apache.org/jira/browse/SPARK-4081 tracks adding categorical
feature indexing, which one-hot encoding can be built on.
https://issues.apache.org/jira/browse/SPARK-1216 also tracks a version of
this prior to the ML pipelines work.
-Sandy
On Fri, Dec 12, 2014 at 6:16 PM, Lochana Menikarachchi <lo...@gmail.com>
wrote:
>
> Do we have one-hot encoding in spark MLLib 1.1.1 or 1.2.0 ? It wasn't
> available in 1.1.0.
> Thanks.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>