You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/07/16 02:53:06 UTC

[jira] [Commented] (SPARK-2501) Handle stage re-submissions properly in the UI

    [ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062950#comment-14062950 ] 

Patrick Wendell commented on SPARK-2501:
----------------------------------------

Our handling of stage re-submissions is broken in the UI. For instance, I looked in the JobProgressListener and we index many things on StageId that might better be indexed on StageId, AttemptId. Also, we should probably give the AttemptId when start a task so that we understand which stage attempt to associated it with. I also don't understand exactly what happens when a stage gets re-attempted, do we send a "stage completed" event? It might be good to fix the way we deal with stage re-submissions to make this work better overall.

> Handle stage re-submissions properly in the UI
> ----------------------------------------------
>
>                 Key: SPARK-2501
>                 URL: https://issues.apache.org/jira/browse/SPARK-2501
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>            Reporter: Patrick Wendell
>            Assignee: Masayoshi TSUZUKI
>            Priority: Critical
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)