You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Derek Dagit (JIRA)" <ji...@apache.org> on 2015/10/08 22:20:27 UTC
[jira] [Commented] (SPARK-10930) History "Stages" page "duration"
can be confusing
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949313#comment-14949313 ]
Derek Dagit commented on SPARK-10930:
-------------------------------------
We should create a new column with the maximum duration of all tasks in the stage. This will let us identify tasks that took the longest time.
> History "Stages" page "duration" can be confusing
> -------------------------------------------------
>
> Key: SPARK-10930
> URL: https://issues.apache.org/jira/browse/SPARK-10930
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 1.5.1
> Reporter: Thomas Graves
>
> The spark history server, "stages" page shows each stage submitted time and the duration. The duration can be confusing since the time it actually starts tasks might be much later then its submitted if its waiting on previous stages. This makes it hard to figure out which stages were really slow without clicking into each stage.
> It would be nice to perhaps have a first task launched time or processing time spent in each stage to easily be able to find the slow stages.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org