You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2019/10/29 18:35:00 UTC
[jira] [Created] (SPARK-29640) [K8S] Make it possible to set DNS
option to use TCP instead of UDP
Andy Grove created SPARK-29640:
----------------------------------
Summary: [K8S] Make it possible to set DNS option to use TCP instead of UDP
Key: SPARK-29640
URL: https://issues.apache.org/jira/browse/SPARK-29640
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 2.4.4
Reporter: Andy Grove
Fix For: 2.4.5
We are running into intermittent DNS issues where the Spark driver fails to resolve "kubernetes.default.svc" and this seems to be caused by [https://github.com/kubernetes/kubernetes/issues/76790]
One suggested workaround is to specify TCP mode for DNS lookups in the pod spec ([https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-424498508]).
I would like the ability to provide a flag to spark-submit to specify to use TCP mode for DNS lookups.
I am working on a PR for this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org