You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2017/07/07 12:10:37 UTC
spark git commit: [SPARK-19358][CORE] LiveListenerBus shall log the
event name when dropping them due to a fully filled queue
Repository: spark
Updated Branches:
refs/heads/master fef081309 -> fbbe37ed4
[SPARK-19358][CORE] LiveListenerBus shall log the event name when dropping them due to a fully filled queue
## What changes were proposed in this pull request?
Some dropped event will make the whole application behaves unexpectedly, e.g. some UI problem...we shall log the dropped event name to facilitate the debugging
## How was this patch tested?
Existing tests
Author: CodingCat <zh...@gmail.com>
Closes #16697 from CodingCat/SPARK-19358.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fbbe37ed
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fbbe37ed
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fbbe37ed
Branch: refs/heads/master
Commit: fbbe37ed416f2ca9d8fc713a135b335b8a0247bf
Parents: fef0813
Author: CodingCat <zh...@gmail.com>
Authored: Fri Jul 7 20:10:24 2017 +0800
Committer: Wenchen Fan <we...@databricks.com>
Committed: Fri Jul 7 20:10:24 2017 +0800
----------------------------------------------------------------------
.../src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala | 1 +
1 file changed, 1 insertion(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/fbbe37ed/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala b/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala
index f0887e0..0dd63d4 100644
--- a/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala
+++ b/core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala
@@ -232,6 +232,7 @@ private[spark] class LiveListenerBus(conf: SparkConf) extends SparkListenerBus {
"This likely means one of the SparkListeners is too slow and cannot keep up with " +
"the rate at which tasks are being started by the scheduler.")
}
+ logTrace(s"Dropping event $event")
}
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org