You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2013/12/14 09:42:04 UTC

[20/50] [abbrv] git commit: Documenting the newly added spark properties.

Documenting the newly added spark properties.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/dca946ff
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/dca946ff
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/dca946ff

Branch: refs/heads/master
Commit: dca946ff6779cda9c50ae0069734b7802bb4d24a
Parents: 560e44a
Author: Prashant Sharma <sc...@gmail.com>
Authored: Tue Nov 26 20:44:47 2013 +0530
Committer: Prashant Sharma <sc...@gmail.com>
Committed: Tue Nov 26 20:47:38 2013 +0530

----------------------------------------------------------------------
 docs/configuration.md | 23 ++++++++++++++++++++++-
 1 file changed, 22 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/dca946ff/docs/configuration.md
----------------------------------------------------------------------
diff --git a/docs/configuration.md b/docs/configuration.md
index 97183ba..25e7cec 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -275,12 +275,33 @@ Apart from these, the following properties are also available, and may be useful
 </tr>
 <tr>
   <td>spark.akka.timeout</td>
-  <td>20</td>
+  <td>60</td>
   <td>
     Communication timeout between Spark nodes, in seconds.
   </td>
 </tr>
 <tr>
+  <td>spark.akka.pauses</td>
+  <td>60</td>
+  <td>
+     Acceptable heart beat pause in seconds for akka, tune this if you expect GC pauses or network delays (reconnections) etc.
+  </td>
+</tr>
+<tr>
+  <td>spark.akka.failure-detector.threshold</td>
+  <td>12.0</td>
+  <td>
+     Tuning this is not recommended unless you are sure what you are doing. This maps to akka's `akka.remote.transport-failure-detector.threshold`. Usually having a larger value of `spark.akka.pauses` should suffice. 
+  </td>
+</tr>
+<tr>
+  <td>spark.akka.heartbeat.interval</td>
+  <td>5</td>
+  <td>
+     A larger interval value in seconds reduces network overhead and a smaller value might be more informative for akka's failure detector. Tune this in combination of `spark.akka.pauses` and `spark.akka.failure-detector.threshold` if you need to.
+  </td>
+</tr>
+<tr>
   <td>spark.driver.host</td>
   <td>(local hostname)</td>
   <td>