You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2026/06/27 05:34:00 UTC

[jira] [Resolved] (SPARK-54879) Add final application status to Spark History Server for failed executions

     [ https://issues.apache.org/jira/browse/SPARK-54879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mridul Muralidharan resolved SPARK-54879.
-----------------------------------------
    Fix Version/s: 5.0.0
       Resolution: Fixed

Issue resolved by pull request 53657
[https://github.com/apache/spark/pull/53657]

> Add final application status to Spark History Server for failed executions
> --------------------------------------------------------------------------
>
>                 Key: SPARK-54879
>                 URL: https://issues.apache.org/jira/browse/SPARK-54879
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core
>    Affects Versions: 4.2.0
>            Reporter: Rob Reeves
>            Assignee: Rob Reeves
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 5.0.0
>
>         Attachments: image-2026-01-01-21-09-52-487.png
>
>
> If a Spark job fails due to an issue on the driver side (e.g. during the commit phase, custom driver code) this is not surfaced anywhere in SHS. This becomes even more confusing when a query/job has run successfully. SHS will show all jobs as completed successfully and the only way to know the job failed is to look in the logs. Before this change this is what a failed driver side application would look like in SHS. It looks like a success.
> !image-2026-01-01-21-09-52-487.png|width=360,height=400!
> To improve this the application failure status should be shown for failures.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org