[jira] [Commented] (SPARK-3468) WebUI Timeline-View feature

["Kousuke Saruta (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394295#comment-14394295 ] 

Kousuke Saruta commented on SPARK-3468:
---------------------------------------

I added 3 timeline features to existing Web UI.

[Application Timeline View]
This view shows following things.

    When each executor was added/removed and the reason why it's removed.
    When each job was started/finished.
    Status of each job.

[Stage Timeline View]
Similar to Application Timeline View, this view shows following things.

    When each executor was added/removed and the reason why it's removed.
    When each job was started/finished.
    Status of each stage.

[Task Assignment Timeline View]
This view shows following things.

    When each task started/finished
    How long each task spent and the proportion.
    Status of each task.
    Where each task ran on.

All the view above is zoomable by mouse wheel action and scrollable by drag action. 

> WebUI Timeline-View feature
> ---------------------------
>
>                 Key: SPARK-3468
>                 URL: https://issues.apache.org/jira/browse/SPARK-3468
>             Project: Spark
>          Issue Type: New Feature
>          Components: Web UI
>    Affects Versions: 1.4.0
>            Reporter: Kousuke Saruta
>         Attachments: tasks.png
>
>
> I sometimes trouble-shoot and analyse the cause of long time spending job.
> At the time, I find the stages which spends long time or fails, then I find the tasks which spends long time or fails, next I analyse the proportion of each phase in a task.
> Another case, I find executors which spends long time for running a task and analyse the details of a task.
> In such situation, I think it's helpful to visualize timeline view of stages / tasks / executors and visualize details of proportion of activity for each task.
> Now I'm developing prototypes like captures I attached.
> I'll integrate these viewer into WebUI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org