You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2015/04/08 19:16:12 UTC

[jira] [Resolved] (SPARK-6506) python support yarn cluster mode requires SPARK_HOME to be set

     [ https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Rosen resolved SPARK-6506.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 1.4.0
                   1.3.2

Issue resolved by pull request 5405
[https://github.com/apache/spark/pull/5405]

> python support yarn cluster mode requires SPARK_HOME to be set
> --------------------------------------------------------------
>
>                 Key: SPARK-6506
>                 URL: https://issues.apache.org/jira/browse/SPARK-6506
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.3.0
>            Reporter: Thomas Graves
>             Fix For: 1.3.2, 1.4.0
>
>
> We added support for python running in yarn cluster mode in https://issues.apache.org/jira/browse/SPARK-5173, but it requires that SPARK_HOME be set in the environment variables for application master and executor.  It doesn't have to be set to anything real but it fails if its not set.  See the command at the end of: https://github.com/apache/spark/pull/3976



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org