You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/07/17 15:36:00 UTC

[jira] [Assigned] (SPARK-24833) Allow specifying Kubernetes host name aliases in the pod specs

     [ https://issues.apache.org/jira/browse/SPARK-24833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-24833:
------------------------------------

    Assignee: Apache Spark

> Allow specifying Kubernetes host name aliases in the pod specs
> --------------------------------------------------------------
>
>                 Key: SPARK-24833
>                 URL: https://issues.apache.org/jira/browse/SPARK-24833
>             Project: Spark
>          Issue Type: Bug
>          Components: Kubernetes
>    Affects Versions: 2.3.1
>            Reporter: Rob Vesse
>            Assignee: Apache Spark
>            Priority: Major
>
> For some workloads you would like to allow Spark executors to access external services using host name aliases.  Currently there is no way to specify Host name aliases (https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/) to the pods that Spark generates and pod presets cannot be used to add these at admission time currently (plus the fact that pod presets are still an Alpha feature so not guaranteed to be usable on any given cluster).
> Since Spark on K8S already allows adding secrets and volumes to mount via Spark configuration it should be fairly easy to use the same approach to include host name aliases.
> I will look at opening a PR for this in the next couple of days.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org