You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Ian Ferreira <ia...@hotmail.com> on 2014/04/01 17:53:52 UTC

Mllib in pyspark for 0.8.1

Hi there,

For some reason the distribution and build for 0.8.1 does not include
the MLLib libraries for pyspark i.e. import from mllib fails.

Seems to be addressed in 0.9.0, but that has other issue running on
mesos in standalone mode :)

Any pointers?

Cheers
- Ian

Re: Mllib in pyspark for 0.8.1

Posted by Matei Zaharia <ma...@gmail.com>.

You could probably port it back, but it required some changes on the Java side as well (a new PythonMLUtils class). It might be easier to fix the Mesos issues with 0.9.

Matei

On Apr 1, 2014, at 8:53 AM, Ian Ferreira <ia...@hotmail.com> wrote:

> 
> Hi there,
> 
> For some reason the distribution and build for 0.8.1 does not include
> the MLLib libraries for pyspark i.e. import from mllib fails.
> 
> Seems to be addressed in 0.9.0, but that has other issue running on
> mesos in standalone mode :)
> 
> Any pointers?
> 
> Cheers
> - Ian
>