[jira] [Updated] (SPARK-12268) pyspark shell uses execfile which breaks python3 compatibility

["Josh Rosen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Rosen updated SPARK-12268:
-------------------------------
    Affects Version/s:     (was: 1.6.1)
                       1.6.0

> pyspark shell uses execfile which breaks python3 compatibility
> --------------------------------------------------------------
>
>                 Key: SPARK-12268
>                 URL: https://issues.apache.org/jira/browse/SPARK-12268
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark
>    Affects Versions: 1.5.2, 1.6.0
>            Reporter: Erik Selin
>            Assignee: Erik Selin
>             Fix For: 1.6.1, 2.0.0
>
>
> The pyspark shell allows custom start scripts to run using the PYTHONSTARTUP environment variable. The value specified there will get run at the end of the shell startup by a call to execfile. However, execfile is deprecated in python3 and thus this does not work for python3 users. The simply fix is to follow the 2to3 recommendation and read, compile and exec the file manually as per this PR: https://github.com/apache/spark/pull/10255



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org