[jira] [Created] (SPARK-4836) Web UI should display separate information for all stage attempts

["Josh Rosen (JIRA)" <ji...@apache.org>]

Josh Rosen created SPARK-4836:
---------------------------------

             Summary: Web UI should display separate information for all stage attempts
                 Key: SPARK-4836
                 URL: https://issues.apache.org/jira/browse/SPARK-4836
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 1.1.1, 1.2.0
            Reporter: Josh Rosen


I've run into some cases where the web UI job page will say that a job took 12 minutes but the sum of that job's stage times is something like 10 seconds.  In this case, it turns out that my job ran a stage to completion (which took, say, 5 minutes) then lost some partitions of that stage and had to run a new stage attempt to recompute one or two tasks from that stage.  As a result, the latest attempt for that stage reports only one or two tasks.  In the web UI, it seems that we only show the latest stage attempt, not all attempts, which can lead to confusing / misleading displays for jobs with failed / partially-recomputed stages.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org