You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Daniel Takabayashi <ta...@scanboo.com.br> on 2014/09/18 20:49:53 UTC
Spark + Mahout
Hi guys,
Is possible to run a mahout kmeans throws spark infrastructure?
Thanks,
taka (Brazil)
Re: Spark + Mahout
Posted by Daniel Takabayashi <ta...@scanboo.com.br>.
Yes, thanks, but I want to test using Fuzzy Kmeans, as an option, is
possible?
2014-09-18 16:40 GMT-03:00 Huang, Roger <ro...@visa.com>:
> Taka,
>
> Have you considered using Spark’s own MLlib k-means clustering?
>
> http://spark.apache.org/docs/latest/mllib-clustering.html
>
>
>
> Roger
>
>
>
> *From:* Daniel Takabayashi [mailto:takabayashi@scanboo.com.br]
> *Sent:* Thursday, September 18, 2014 1:50 PM
> *To:* user@spark.apache.org
> *Subject:* Spark + Mahout
>
>
>
> Hi guys,
>
>
>
> Is possible to run a mahout kmeans throws spark infrastructure?
>
>
>
>
>
> Thanks,
>
> taka (Brazil)
>
RE: Spark + Mahout
Posted by "Huang, Roger" <ro...@visa.com>.
Taka,
Have you considered using Spark’s own MLlib k-means clustering?
http://spark.apache.org/docs/latest/mllib-clustering.html
Roger
From: Daniel Takabayashi [mailto:takabayashi@scanboo.com.br]
Sent: Thursday, September 18, 2014 1:50 PM
To: user@spark.apache.org
Subject: Spark + Mahout
Hi guys,
Is possible to run a mahout kmeans throws spark infrastructure?
Thanks,
taka (Brazil)
Re: Spark + Mahout
Posted by Matthew Farrellee <ma...@redhat.com>.
On 09/19/2014 05:06 AM, Sean Owen wrote:
> No, it is actually a quite different 'alpha' project under the same
> name: linear algebra DSL on top of H2O and also Spark. It is not really
> about algorithm implementations now.
>
> On Sep 19, 2014 1:25 AM, "Matthew Farrellee" <matt@redhat.com
> <ma...@redhat.com>> wrote:
>
> On 09/18/2014 05:40 PM, Sean Owen wrote:
>
> No, the architectures are entirely different. The Mahout
> implementations
> have been deprecated and are not being updated, so there won't
> be a port
> or anything. You would have to create these things from scratch
> on Spark
> if they don't already exist.
>
> On Sep 18, 2014 7:50 PM, "Daniel Takabayashi"
> <takabayashi@scanboo.com.br <ma...@scanboo.com.br>
> <mailto:takabayashi@scanboo.__com.br
> <ma...@scanboo.com.br>>> wrote:
>
> Hi guys,
>
> Is possible to run a mahout kmeans throws spark infrastructure?
>
>
> Thanks,
> taka (Brazil)
>
>
> from what i've read, mahout isn't accepting changes to MR-based
> implementations. would mahout accept an implementation on Spark?
>
> best,
>
>
> matt
oic. where's a good place to see progress on that?
best,
matt
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Spark + Mahout
Posted by Sean Owen <so...@cloudera.com>.
No, it is actually a quite different 'alpha' project under the same name:
linear algebra DSL on top of H2O and also Spark. It is not really about
algorithm implementations now.
On Sep 19, 2014 1:25 AM, "Matthew Farrellee" <ma...@redhat.com> wrote:
> On 09/18/2014 05:40 PM, Sean Owen wrote:
>
>> No, the architectures are entirely different. The Mahout implementations
>> have been deprecated and are not being updated, so there won't be a port
>> or anything. You would have to create these things from scratch on Spark
>> if they don't already exist.
>>
>> On Sep 18, 2014 7:50 PM, "Daniel Takabayashi"
>> <takabayashi@scanboo.com.br <ma...@scanboo.com.br>> wrote:
>>
>> Hi guys,
>>
>> Is possible to run a mahout kmeans throws spark infrastructure?
>>
>>
>> Thanks,
>> taka (Brazil)
>>
>>
> from what i've read, mahout isn't accepting changes to MR-based
> implementations. would mahout accept an implementation on Spark?
>
> best,
>
>
> matt
>
Re: Spark + Mahout
Posted by Sean Owen <so...@cloudera.com>.
No, the architectures are entirely different. The Mahout implementations
have been deprecated and are not being updated, so there won't be a port or
anything. You would have to create these things from scratch on Spark if
they don't already exist.
On Sep 18, 2014 7:50 PM, "Daniel Takabayashi" <ta...@scanboo.com.br>
wrote:
> Hi guys,
>
> Is possible to run a mahout kmeans throws spark infrastructure?
>
>
> Thanks,
> taka (Brazil)
>