You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2016/09/14 08:03:19 UTC
spark git commit: [SPARK-17449][DOCUMENTATION] Relation between heartbeatInterval and…
Repository: spark
Updated Branches:
refs/heads/master a454a4d86 -> def7c265f
[SPARK-17449][DOCUMENTATION] Relation between heartbeatInterval and\u2026
## What changes were proposed in this pull request?
The relation between spark.network.timeout and spark.executor.heartbeatInterval should be mentioned in the document.
\u2026 network timeout]
Author: Jagadeesan <as...@us.ibm.com>
Closes #15042 from jagadeesanas2/SPARK-17449.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/def7c265
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/def7c265
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/def7c265
Branch: refs/heads/master
Commit: def7c265f539f3e119f068b6e9050300d05b14a4
Parents: a454a4d
Author: Jagadeesan <as...@us.ibm.com>
Authored: Wed Sep 14 09:03:16 2016 +0100
Committer: Sean Owen <so...@cloudera.com>
Committed: Wed Sep 14 09:03:16 2016 +0100
----------------------------------------------------------------------
core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala | 1 +
docs/configuration.md | 3 ++-
2 files changed, 3 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/def7c265/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala b/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
index c3764ac..5242ab6 100644
--- a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
+++ b/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala
@@ -32,6 +32,7 @@ import org.apache.spark.util._
* A heartbeat from executors to the driver. This is a shared message used by several internal
* components to convey liveness or execution information for in-progress tasks. It will also
* expire the hosts that have not heartbeated for more than spark.network.timeout.
+ * spark.executor.heartbeatInterval should be significantly less than spark.network.timeout.
*/
private[spark] case class Heartbeat(
executorId: String,
http://git-wip-us.apache.org/repos/asf/spark/blob/def7c265/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index ebd0aa7..8aea745 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -987,7 +987,8 @@ Apart from these, the following properties are also available, and may be useful
<td>10s</td>
<td>Interval between each executor's heartbeats to the driver. Heartbeats let
the driver know that the executor is still alive and update it with metrics for in-progress
- tasks.</td>
+ tasks. spark.executor.heartbeatInterval should be significantly less than
+ spark.network.timeout</td>
</tr>
<tr>
<td><code>spark.files.fetchTimeout</code></td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org