You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Erik Selin (JIRA)" <ji...@apache.org> on 2016/01/04 17:21:39 UTC

[jira] [Commented] (SPARK-12268) pyspark shell uses execfile which breaks python3 compatibility

    [ https://issues.apache.org/jira/browse/SPARK-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081317#comment-15081317 ] 

Erik Selin commented on SPARK-12268:
------------------------------------

Any reason to keep this from getting merged? The PR is good to go imo :)

> pyspark shell uses execfile which breaks python3 compatibility
> --------------------------------------------------------------
>
>                 Key: SPARK-12268
>                 URL: https://issues.apache.org/jira/browse/SPARK-12268
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark
>    Affects Versions: 1.5.2, 1.6.1
>            Reporter: Erik Selin
>            Assignee: Apache Spark
>
> The pyspark shell allows custom start scripts to run using the PYTHONSTARTUP environment variable. The value specified there will get run at the end of the shell startup by a call to execfile. However, execfile is deprecated in python3 and thus this does not work for python3 users. The simply fix is to follow the 2to3 recommendation and read, compile and exec the file manually as per this PR: https://github.com/apache/spark/pull/10255



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org