You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Frederic Hemery (Jira)" <ji...@apache.org> on 2025/03/16 20:22:00 UTC
[jira] [Updated] (SPARK-51523) Make Kubernetes driver service domain configurable
[ https://issues.apache.org/jira/browse/SPARK-51523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Frederic Hemery updated SPARK-51523:
------------------------------------
Description:
Currently, the DNS record used by Spark worker pods for the driver is {{{}<driver name>.<driver namespace>.svc{}}}. This is set [here|#L55].]
This requires that the pods are configured with specific search domains for this DNS to properly resolve. It would be convenient to be able to configure the domain to use. This would default to {{svc}} for backward compatibility.
was:
Currently, the DNS record used by Spark worker pods for the driver is `<driver name>.<driver namespace>.svc`. This is set [here|[https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/DriverServiceFeatureStep.scala#L55].]
This requires that the pods are configured with specific search domains for this DNS to properly resolve. It would be convenient to be able to configure the domain to use. This would default to `svc` for backward compatibility.
> Make Kubernetes driver service domain configurable
> --------------------------------------------------
>
> Key: SPARK-51523
> URL: https://issues.apache.org/jira/browse/SPARK-51523
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.5.5
> Reporter: Frederic Hemery
> Priority: Major
>
> Currently, the DNS record used by Spark worker pods for the driver is {{{}<driver name>.<driver namespace>.svc{}}}. This is set [here|#L55].]
>
> This requires that the pods are configured with specific search domains for this DNS to properly resolve. It would be convenient to be able to configure the domain to use. This would default to {{svc}} for backward compatibility.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org