You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kay Ousterhout (JIRA)" <ji...@apache.org> on 2014/11/05 07:55:35 UTC
[jira] [Updated] (SPARK-3984) Display task deserialization time in
the UI
[ https://issues.apache.org/jira/browse/SPARK-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kay Ousterhout updated SPARK-3984:
----------------------------------
Description:
Right now, the UI does not display the time to deserialize the task, which can be significant when running short jobs (e.g., ML).
cc [~sparks] [~shivaram]
was:
Right now, the UI does not display the time to deserialize the task, to serialize the task result, or to launch a new thread for the task. When running short jobs (e.g., for ML) these overheads can become significant. It would be great to show these in the summary quantiles for each stage in the UI to facilitate better performance debugging.
cc [~sparks] [~shivaram]
Summary: Display task deserialization time in the UI (was: Display finer grained metrics about task launch overhead in the UI)
> Display task deserialization time in the UI
> -------------------------------------------
>
> Key: SPARK-3984
> URL: https://issues.apache.org/jira/browse/SPARK-3984
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Fix For: 1.2.0
>
>
> Right now, the UI does not display the time to deserialize the task, which can be significant when running short jobs (e.g., ML).
> cc [~sparks] [~shivaram]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org