You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2023/08/01 01:59:35 UTC
[spark] branch master updated: [SPARK-44583][DOC] `spark.*.io.connectionCreationTimeout` parameter documentation
This is an automated email from the ASF dual-hosted git repository.
yao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 772ebd31252 [SPARK-44583][DOC] `spark.*.io.connectionCreationTimeout` parameter documentation
772ebd31252 is described below
commit 772ebd312520895244aff0b3d65f9f2d8dddf406
Author: sychen <sy...@ctrip.com>
AuthorDate: Tue Aug 1 09:59:21 2023 +0800
[SPARK-44583][DOC] `spark.*.io.connectionCreationTimeout` parameter documentation
### What changes were proposed in this pull request?
### Why are the changes needed?
`spark.*.io.connectionCreationTimeout` The parameter description is missing, and the default time of the comment is wrong.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Closes #42205 from cxzl25/SPARK-44583.
Authored-by: sychen <sy...@ctrip.com>
Signed-off-by: Kent Yao <ya...@apache.org>
---
.../apache/spark/network/util/TransportConf.java | 2 +-
docs/configuration.md | 24 ++++++++++++++++++++++
2 files changed, 25 insertions(+), 1 deletion(-)
diff --git a/common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java b/common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
index deac78ffedd..45e9994be72 100644
--- a/common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
+++ b/common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
@@ -106,7 +106,7 @@ public class TransportConf {
return defaultTimeoutMs < 0 ? 0 : (int) defaultTimeoutMs;
}
- /** Connect creation timeout in milliseconds. Default 30 secs. */
+ /** Connect creation timeout in milliseconds. Default 120 secs. */
public int connectionCreationTimeoutMs() {
long connectionTimeoutS = TimeUnit.MILLISECONDS.toSeconds(connectionTimeoutMs());
long defaultTimeoutMs = JavaUtils.timeStringAsSec(
diff --git a/docs/configuration.md b/docs/configuration.md
index fbbb9b95f71..99ef0559558 100644
--- a/docs/configuration.md
+++ b/docs/configuration.md
@@ -1041,6 +1041,14 @@ Apart from these, the following properties are also available, and may be useful
</td>
<td>1.2.0</td>
</tr>
+<tr>
+ <td><code>spark.shuffle.io.connectionCreationTimeout</code></td>
+ <td>value of <code>spark.shuffle.io.connectionTimeout</code></td>
+ <td>
+ Timeout for establishing a connection between the shuffle servers and clients.
+ </td>
+ <td>3.2.0</td>
+</tr>
<tr>
<td><code>spark.shuffle.service.enabled</code></td>
<td>false</td>
@@ -1217,6 +1225,14 @@ Apart from these, the following properties are also available, and may be useful
</td>
<td>1.6.0</td>
</tr>
+<tr>
+ <td><code>spark.files.io.connectionCreationTimeout</code></td>
+ <td>value of <code>spark.files.io.connectionTimeout</code></td>
+ <td>
+ Timeout for establishing a connection for fetching files in Spark RPC environments.
+ </td>
+ <td>3.2.0</td>
+</tr>
<tr>
<td><code>spark.shuffle.checksum.enabled</code></td>
<td>true</td>
@@ -2442,6 +2458,14 @@ Apart from these, the following properties are also available, and may be useful
</td>
<td>1.2.0</td>
</tr>
+<tr>
+ <td><code>spark.rpc.io.connectionCreationTimeout</code></td>
+ <td>value of <code>spark.rpc.io.connectionTimeout</code></td>
+ <td>
+ Timeout for establishing a connection between RPC peers.
+ </td>
+ <td>3.2.0</td>
+</tr>
</table>
### Scheduling
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org