You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@datafu.apache.org by "Matthew Hayes (Jira)" <ji...@apache.org> on 2020/03/26 19:05:00 UTC

[jira] [Created] (DATAFU-153) datafu-spark tests fail with Python 3

Matthew Hayes created DATAFU-153:
------------------------------------

             Summary: datafu-spark tests fail with Python 3
                 Key: DATAFU-153
                 URL: https://issues.apache.org/jira/browse/DATAFU-153
             Project: DataFu
          Issue Type: Bug
            Reporter: Matthew Hayes


When local Python version is 3.x, there is an error thrown from SparkPythonRunner due to execfile not being in Python 3.  The tests work for Python 2.7.
{code:java}
java.lang.RuntimeException: python bridge error: 
Python 3.6.0 (default, Jun  6 2018, 13:47:36) 

[GCC 4.2.1 Compatible Apple LLVM 9.1.0 (clang-902.0.39.2)] on darwin

Type "help", "copyright", "credits" or "license" for more information.

>>> >>> ... ... ... ... ... ... Traceback (most recent call last):

  File "<stdin>", line 2, in <module>

NameError: name 'execfile' is not defined

	at org.apache.spark.datafu.deploy.SparkPythonRunner.execFile(SparkPythonRunner.scala:134)
	at org.apache.spark.datafu.deploy.SparkPythonRunner.runPyFile(SparkPythonRunner.scala:49) {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)