You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ka...@apache.org on 2014/07/21 05:18:37 UTC
git commit: Improve scheduler delay tooltip.
Repository: spark
Updated Branches:
refs/heads/master b86db517b -> f6e7302cb
Improve scheduler delay tooltip.
As a result of shivaram's experience debugging long scheduler delay, I think we should improve the tooltip to point people in the right direction if scheduler delay is large.
Author: Kay Ousterhout <ka...@gmail.com>
Closes #1488 from kayousterhout/better_tooltips and squashes the following commits:
22176fd [Kay Ousterhout] Improve scheduler delay tooltip.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f6e7302c
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f6e7302c
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f6e7302c
Branch: refs/heads/master
Commit: f6e7302cb49ee227aed537026d19f68528051dfd
Parents: b86db51
Author: Kay Ousterhout <ka...@gmail.com>
Authored: Sun Jul 20 20:18:18 2014 -0700
Committer: Kay Ousterhout <ka...@gmail.com>
Committed: Sun Jul 20 20:18:18 2014 -0700
----------------------------------------------------------------------
core/src/main/scala/org/apache/spark/ui/ToolTips.scala | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/f6e7302c/core/src/main/scala/org/apache/spark/ui/ToolTips.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/ui/ToolTips.scala b/core/src/main/scala/org/apache/spark/ui/ToolTips.scala
index 37708d7..9ced9b8 100644
--- a/core/src/main/scala/org/apache/spark/ui/ToolTips.scala
+++ b/core/src/main/scala/org/apache/spark/ui/ToolTips.scala
@@ -20,9 +20,9 @@ package org.apache.spark.ui
private[spark] object ToolTips {
val SCHEDULER_DELAY =
"""Scheduler delay includes time to ship the task from the scheduler to
- the executor, and time the time to send a message from the executor to the scheduler stating
- that the task has completed. When the scheduler becomes overloaded, task completion messages
- become queued up, and scheduler delay increases."""
+ the executor, and time to send the task result from the executor to the scheduler. If
+ scheduler delay is large, consider decreasing the size of tasks or decreasing the size
+ of task results."""
val INPUT = "Bytes read from Hadoop or from Spark storage."