You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kay Ousterhout (JIRA)" <ji...@apache.org> on 2014/06/18 22:22:24 UTC

[jira] [Resolved] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

     [ https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kay Ousterhout resolved SPARK-1466.
-----------------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 1.0.1)
                   1.1.0

> Pyspark doesn't check if gateway process launches correctly
> -----------------------------------------------------------
>
>                 Key: SPARK-1466
>                 URL: https://issues.apache.org/jira/browse/SPARK-1466
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark
>    Affects Versions: 0.9.0, 0.9.1
>            Reporter: Kay Ousterhout
>            Assignee: Kay Ousterhout
>            Priority: Blocker
>             Fix For: 1.1.0
>
>
> If the gateway process fails to start correctly (e.g., because JAVA_HOME isn't set correctly, there's no Spark jar, etc.), right now pyspark fails because of a very difficult-to-understand error, where we try to parse stdout to get the port where Spark started and there's nothing there.  We should properly catch the error, print it to the user, and exit.



--
This message was sent by Atlassian JIRA
(v6.2#6252)