[jira] [Closed] (SPARK-3759) SparkSubmitDriverBootstrapper should return exit code of driver process

["Andrew Or (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Or closed SPARK-3759.
----------------------------
          Resolution: Fixed
       Fix Version/s: 1.2.0
                      1.1.1
            Assignee: Eric Eijkelenboom
    Target Version/s: 1.1.1, 1.2.0

> SparkSubmitDriverBootstrapper should return exit code of driver process
> -----------------------------------------------------------------------
>
>                 Key: SPARK-3759
>                 URL: https://issues.apache.org/jira/browse/SPARK-3759
>             Project: Spark
>          Issue Type: Bug
>          Components: Deploy
>    Affects Versions: 1.1.0
>         Environment: Linux, Windows, Scala/Java
>            Reporter: Eric Eijkelenboom
>            Assignee: Eric Eijkelenboom
>            Priority: Minor
>             Fix For: 1.1.1, 1.2.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> SparkSubmitDriverBootstrapper.scala currently always returns exit code 0. Instead, it should return the exit code of the driver process.
> Suggested code change in SparkSubmitDriverBootstrapper, line 157: 
> {code}
> val returnCode = process.waitFor()
> sys.exit(returnCode)
> {code}
> Workaround for this issue: 
> Instead of specifying 'driver.extra*' properties in spark-defaults.conf, pass these properties to spark-submit directly. This will launch the driver program without the use of SparkSubmitDriverBootstrapper. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org