You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2023/08/08 23:03:58 UTC
[spark] branch branch-3.5 updated: [SPARK-44725][DOCS] Document `spark.network.timeoutInterval`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new aa4288cf59a [SPARK-44725][DOCS] Document `spark.network.timeoutInterval`
aa4288cf59a is described below
commit aa4288cf59a9daad37c3a2314677f489691da3b7
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Tue Aug 8 16:03:38 2023 -0700
[SPARK-44725][DOCS] Document `spark.network.timeoutInterval`
### What changes were proposed in this pull request?
This PR aims to document `spark.network.timeoutInterval` configuration.
### Why are the changes needed?
Like `spark.network.timeout`, `spark.network.timeoutInterval` exists since Apache Spark 1.3.x.
https://github.com/apache/spark/blob/418bba5ad6053449a141f3c9c31ed3ad998995b8/core/src/main/scala/org/apache/spark/internal/config/Network.scala#L48-L52
Since this is a user-facing configuration like the following, we had better document it.
https://github.com/apache/spark/blob/418bba5ad6053449a141f3c9c31ed3ad998995b8/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala#L91-L93
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual because this is a doc-only change.
Closes #42402 from dongjoon-hyun/SPARK-44725.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit 3af2e77bd20cad3d9fe23cc0689eed29d5f5a537)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/configuration.md | 8 ++++++++
1 file changed, 8 insertions(+)
diff --git a/docs/configuration.md b/docs/configuration.md
index 99ef0559558..a70c049c87c 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -2397,6 +2397,14 @@ Apart from these, the following properties are also available, and may be useful
</td>
<td>1.3.0</td>
</tr>
+<tr>
+ <td><code>spark.network.timeoutInterval</code></td>
+ <td>60s</td>
+ <td>
+ Interval for the driver to check and expire dead executors.
+ </td>
+ <td>1.3.2</td>
+</tr>
<tr>
<td><code>spark.network.io.preferDirectBufs</code></td>
<td>true</td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org