You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Prashant Sharma (JIRA)" <ji...@apache.org> on 2019/01/16 09:15:00 UTC
[jira] [Commented] (SPARK-26059) Spark standalone mode, does not
correctly record a failed Spark Job.
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743783#comment-16743783 ]
Prashant Sharma commented on SPARK-26059:
-----------------------------------------
One work around is to capture the JVM exit code for the driver jvm. It is non-zero if job fails and there are exceptions, and zero if the job is successful.
> Spark standalone mode, does not correctly record a failed Spark Job.
> --------------------------------------------------------------------
>
> Key: SPARK-26059
> URL: https://issues.apache.org/jira/browse/SPARK-26059
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Spark Core
> Affects Versions: 3.0.0
> Reporter: Prashant Sharma
> Priority: Major
>
> In order to reproduce submit a failing job to spark standalone master. The status for the failed job is shown as FINISHED, irrespective of the fact it failed or succeeded.
> EDIT: It happens only when deploy-mode is client, and when deploy mode is cluster it works as expected.
> - Reported by: Surbhi Bakhtiyar.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org