You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Piotr Migdał (JIRA)" <ji...@apache.org> on 2015/08/13 16:13:45 UTC
[jira] [Comment Edited] (SPARK-9705) outdated Python 3 and IPython
information
[ https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695273#comment-14695273 ]
Piotr Migdał edited comment on SPARK-9705 at 8/13/15 2:13 PM:
--------------------------------------------------------------
I added it as I am having problems with running it on Python 3.4 (and it runs smoothly on 2.7). So I was not sure whether it's a problem with my installation/configuration or it isn't supported.
("Exception: Python in worker has different version 2.7 than that in driver 3.4, PySpark cannot run with different minor versions")
I was told by Josh Rosen that 3.4 is supported. However, it makes to sense for me to write docs if I cannot run it on mine computer (maybe there are some options needed?). The error is the same no matter if I run it from command line (specifying paths to Python 3 libraries) or through a preferred option for me - findspark in IPython Notebook (opened with $ ipython notebook).
was (Author: pmigdal):
I added it as I am having problems with running it on Python 3.4 (and it runs smoothly on 2.7). So I was not sure whether it's a problem with my installation/configuration or it isn't supported.
("Exception: Python in worker has different version 2.7 than that in driver 3.4, PySpark cannot run with different minor versions")
I was told by Josh Rosen that 3.4 is supported. However, it makes to sense for me to write docs if I cannot run it on mine computer (maybe there are some options needed?). The error is the same no matter if I run it from command line (specifying paths to Python 3 libraries) or through a preferred option for me - findspark in IPython Notebook.
> outdated Python 3 and IPython information
> -----------------------------------------
>
> Key: SPARK-9705
> URL: https://issues.apache.org/jira/browse/SPARK-9705
> Project: Spark
> Issue Type: Documentation
> Components: Documentation, PySpark
> Affects Versions: 1.4.0, 1.4.1, 1.5.0
> Reporter: Piotr Migdał
> Priority: Blocker
> Labels: documentation
> Original Estimate: 0.25h
> Remaining Estimate: 0.25h
>
> https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0) says explicitly:
> "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)."
> Affected:
> https://spark.apache.org/docs/1.4.0/programming-guide.html
> https://spark.apache.org/docs/1.4.1/programming-guide.html
> There are some other Python-related things, which are outdated, e.g. this line:
> "For example, to launch the IPython Notebook with PyLab plot support:"
> (At least since IPython 3.0 PyLab/Matplotlib support happens inside a notebook; and the line "--pylab inline" is already removed.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org