You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2021/10/26 07:49:03 UTC

[spark] branch master updated: [SPARK-36890][K8S] Use default WebsocketPingInterval for Kubernetes watches

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 457b75e  [SPARK-36890][K8S] Use default WebsocketPingInterval for Kubernetes watches
457b75e is described below

commit 457b75ea2bca6b5811d61ce9f1d28c94b0dde3a2
Author: Philipp Dallig <ph...@gmail.com>
AuthorDate: Tue Oct 26 00:47:58 2021 -0700

    [SPARK-36890][K8S] Use default WebsocketPingInterval for Kubernetes watches
    
    ### What changes were proposed in this pull request?
    This pull request removes the configuration that disables the WebsocketPingInterval. The default value of the [fabric8io/kubernetes-client](https://github.com/fabric8io/kubernetes-client/blob/master/README.md) library is 30 seconds.
    
    Users still can fallback to `0` if needed.
    ```
    export KUBERNETES_WEBSOCKET_PING_INTERVAL=0
    ```
    
    ### Why are the changes needed?
    With a periodical websocket ping, the tunnel timeout in loadbalancers should work as expected.
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    It is not possible for me to write a test for this particular infrastructure. I have checked the setting locally within my infrastructure.
    
    Closes #34143 from Reamer/k8s_api_websocket_ping.
    
    Authored-by: Philipp Dallig <ph...@gmail.com>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 .../scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala | 1 -
 1 file changed, 1 deletion(-)

diff --git a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
index 191cd3d..4131605 100644
--- a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
+++ b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
@@ -88,7 +88,6 @@ private[spark] object SparkKubernetesClientFactory extends Logging {
     val config = new ConfigBuilder(autoConfigure(kubeContext.getOrElse(null)))
       .withApiVersion("v1")
       .withMasterUrl(master)
-      .withWebsocketPingInterval(0)
       .withRequestTimeout(clientType.requestTimeout(sparkConf))
       .withConnectionTimeout(clientType.connectionTimeout(sparkConf))
       .withTrustCerts(sparkConf.get(KUBERNETES_TRUST_CERTIFICATES))

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org