You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kay Ousterhout (JIRA)" <ji...@apache.org> on 2014/04/10 23:18:18 UTC

[jira] [Created] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

Kay Ousterhout created SPARK-1466:
-------------------------------------

             Summary: Pyspark doesn't check if gateway process launches correctly
                 Key: SPARK-1466
                 URL: https://issues.apache.org/jira/browse/SPARK-1466
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 0.9.0, 0.9.1
            Reporter: Kay Ousterhout
            Assignee: Kay Ousterhout
             Fix For: 1.0.0


If the gateway process fails to start correctly (e.g., because JAVA_HOME isn't set correctly, there's no Spark jar, etc.), right now pyspark fails because of a very difficult-to-understand error, where we try to parse stdout to get the port where Spark started and there's nothing there.  We should properly catch the error, print it to the user, and exit.



--
This message was sent by Atlassian JIRA
(v6.2#6252)