You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2019/10/29 18:35:00 UTC

[jira] [Created] (SPARK-29640) [K8S] Make it possible to set DNS option to use TCP instead of UDP

Andy Grove created SPARK-29640:
----------------------------------

             Summary: [K8S] Make it possible to set DNS option to use TCP instead of UDP
                 Key: SPARK-29640
                 URL: https://issues.apache.org/jira/browse/SPARK-29640
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.4.4
            Reporter: Andy Grove
             Fix For: 2.4.5


We are running into intermittent DNS issues where the Spark driver fails to resolve "kubernetes.default.svc" and this seems to be caused by [https://github.com/kubernetes/kubernetes/issues/76790]

One suggested workaround is to specify TCP mode for DNS lookups in the pod spec ([https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-424498508]).

I would like the ability to provide a flag to spark-submit to specify to use TCP mode for DNS lookups.

I am working on a PR for this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org