You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kay Ousterhout (JIRA)" <ji...@apache.org> on 2014/10/17 03:12:33 UTC
[jira] [Commented] (SPARK-3984) Display finer grained metrics about
task launch overhead in the UI
[ https://issues.apache.org/jira/browse/SPARK-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174575#comment-14174575 ]
Kay Ousterhout commented on SPARK-3984:
---------------------------------------
https://github.com/apache/spark/pull/2832
> Display finer grained metrics about task launch overhead in the UI
> ------------------------------------------------------------------
>
> Key: SPARK-3984
> URL: https://issues.apache.org/jira/browse/SPARK-3984
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Fix For: 1.2.0
>
>
> Right now, the UI does not display the time to deserialize the task, to serialize the task result, or to launch a new thread for the task. When running short jobs (e.g., for ML) these overheads can become significant. It would be great to show these in the summary quantiles for each stage in the UI to facilitate better performance debugging.
> cc [~sparks] [~shivaram]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org