You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/03 00:13:00 UTC

[jira] [Updated] (SPARK-4836) Web UI should display separate information for all stage attempts

     [ https://issues.apache.org/jira/browse/SPARK-4836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-4836:
----------------------------------
    Labels: bulk-closed pull-request-available  (was: bulk-closed)

> Web UI should display separate information for all stage attempts
> -----------------------------------------------------------------
>
>                 Key: SPARK-4836
>                 URL: https://issues.apache.org/jira/browse/SPARK-4836
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 1.1.1, 1.2.0
>            Reporter: Josh Rosen
>            Priority: Major
>              Labels: bulk-closed, pull-request-available
>
> I've run into some cases where the web UI job page will say that a job took 12 minutes but the sum of that job's stage times is something like 10 seconds.  In this case, it turns out that my job ran a stage to completion (which took, say, 5 minutes) then lost some partitions of that stage and had to run a new stage attempt to recompute one or two tasks from that stage.  As a result, the latest attempt for that stage reports only one or two tasks.  In the web UI, it seems that we only show the latest stage attempt, not all attempts, which can lead to confusing / misleading displays for jobs with failed / partially-recomputed stages.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org