[jira] [Resolved] (SPARK-6973) The total stages on the allJobsPage is wrong

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-6973.
------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.0

Issue resolved by pull request 5550
[https://github.com/apache/spark/pull/5550]

> The total stages on the allJobsPage is wrong
> --------------------------------------------
>
>                 Key: SPARK-6973
>                 URL: https://issues.apache.org/jira/browse/SPARK-6973
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>            Reporter: meiyoula
>            Priority: Minor
>             Fix For: 1.5.0
>
>         Attachments: allJobs.png
>
>
> The job has two stages,  map and collect stage. Both two retried two times. The first and second time of map stage is successful, and the third time skipped. Of collect stage, the first and second time is failed, and the third time is successful.
> On the allJobs page, the number of total stages is allStages-skippedStages. Mostly it's wright, but here I think total stages should be 2.
> The example:
> Stage 0: Map Stage
> Stage 1: Collect Stage
> Stage:     Stage 0 -> Stage 1 -> Stage 0(retry 1) -> Stage 1(retry 1) -> Stage 0(retry 2) -> Stage 1(retry 2)
> Status：  Success ->     Fail     ->        Success       ->             Fail      ->                Skipped     ->             Success
> Though one of Stage 0 is skipped, actually it's executed. So I think it should be included in the total number.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org