[jira] [Created] (SPARK-25220) [K8S] Split out node selector config between driver and executors.

["Jonathan A Weaver (JIRA)" <ji...@apache.org>]

Jonathan A Weaver created SPARK-25220:
-----------------------------------------

             Summary: [K8S] Split out node selector config between driver and executors.
                 Key: SPARK-25220
                 URL: https://issues.apache.org/jira/browse/SPARK-25220
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.4.0
            Reporter: Jonathan A Weaver


Seperated node selector config option between executors and driver.

This removes the spark.kubernetes.node.selector config option and seperates it to
spark.kubernetes.driver.selector and spark.kubernetes.executor.selector

to allow seperate node selectors on drivers and executors.

My personal use case for this change is that on AWS we have cheap spotinstances that can terminate at any moment which is okay for executors but not the driver.
With a single node selector option I am unable to use the spot instances to save costs on the executor nodes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org