[jira] [Created] (SPARK-24833) Allow specifying Kubernetes host name aliases in the pod specs

["Rob Vesse (JIRA)" <ji...@apache.org>]

Rob Vesse created SPARK-24833:
---------------------------------

             Summary: Allow specifying Kubernetes host name aliases in the pod specs
                 Key: SPARK-24833
                 URL: https://issues.apache.org/jira/browse/SPARK-24833
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 2.3.1
            Reporter: Rob Vesse


For some workloads you would like to allow Spark executors to access external services using host name aliases.  Currently there is no way to specify Host name aliases (https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/) to the pods that Spark generates and pod presets cannot be used to add these at admission time currently (plus the fact that pod presets are still an Alpha feature so not guaranteed to be usable on any given cluster).

Since Spark on K8S already allows adding secrets and volumes to mount via Spark configuration it should be fairly easy to use the same approach to include host name aliases.

I will look at opening a PR for this in the next couple of days.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org