You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Kay Ousterhout (JIRA)" <ji...@apache.org> on 2014/10/17 03:04:33 UTC

[jira] [Created] (SPARK-3984) Display finer grained metrics about task launch overhead in the UI

Kay Ousterhout created SPARK-3984:
-------------------------------------

             Summary: Display finer grained metrics about task launch overhead in the UI
                 Key: SPARK-3984
                 URL: https://issues.apache.org/jira/browse/SPARK-3984
             Project: Spark
          Issue Type: Improvement
          Components: Web UI
            Reporter: Kay Ousterhout
            Assignee: Kay Ousterhout
             Fix For: 1.2.0


Right now, the UI does not display the time to deserialize the task, to serialize the task result, or to launch a new thread for the task.  When running short jobs (e.g., for ML) these overheads can become significant.  It would be great to show these in the summary quantiles for each stage in the UI to facilitate better performance debugging.

cc [~sparks] [~shivaram]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org