You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ariel Rokem <ar...@gmail.com> on 2014/10/03 23:35:04 UTC
pyspark on python 3
Hi everyone,
What is the state of affairs w.r.t python 3? Is this still post still a
good description of the situation?
https://groups.google.com/forum/#!topic/spark-users/GRKmVo0ZDBc
Thanks!
Ariel
Re: pyspark on python 3
Posted by Josh Rosen <ro...@gmail.com>.
It would be great if we supported Python 3 and I'd be happy to review any
pull requests to add it. I don't know that Python 3 is very widely-used,
but I'm open to supporting it if it won't require too much work.
By the way, we recently added support for PyPy:
https://github.com/apache/spark/pull/2144
- Josh
On Fri, Oct 3, 2014 at 6:44 PM, tomo cocoa <co...@gmail.com> wrote:
> Hi,
>
> I prefer that PySpark can also be executed on Python 3.
>
> Do you have some reason or demand to use PySpark through Python3?
> If you create an issue on JIRA, I would try to resolve it.
>
>
> On 4 October 2014 06:47, Gen <ge...@gmail.com> wrote:
>
>> According to the official site of spark, for the latest version of
>> spark(1.1.0), it does not work with python 3
>>
>> Spark 1.1.0 works with Python 2.6 or higher (but not Python 3). It uses
>> the
>> standard CPython interpreter, so C libraries like NumPy can be used.
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-on-python-3-tp15706p15707.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
>
> --
> class Cocoatomo:
> name = 'cocoatomo'
> email_address = 'cocoatomo77@gmail.com'
> twitter_id = '@cocoatomo'
>
Re: pyspark on python 3
Posted by tomo cocoa <co...@gmail.com>.
Hi,
I prefer that PySpark can also be executed on Python 3.
Do you have some reason or demand to use PySpark through Python3?
If you create an issue on JIRA, I would try to resolve it.
On 4 October 2014 06:47, Gen <ge...@gmail.com> wrote:
> According to the official site of spark, for the latest version of
> spark(1.1.0), it does not work with python 3
>
> Spark 1.1.0 works with Python 2.6 or higher (but not Python 3). It uses the
> standard CPython interpreter, so C libraries like NumPy can be used.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-on-python-3-tp15706p15707.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
--
class Cocoatomo:
name = 'cocoatomo'
email_address = 'cocoatomo77@gmail.com'
twitter_id = '@cocoatomo'
Re: pyspark on python 3
Posted by Gen <ge...@gmail.com>.
According to the official site of spark, for the latest version of
spark(1.1.0), it does not work with python 3
Spark 1.1.0 works with Python 2.6 or higher (but not Python 3). It uses the
standard CPython interpreter, so C libraries like NumPy can be used.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/pyspark-on-python-3-tp15706p15707.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org