You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Franco (Jira)" <ji...@apache.org> on 2019/08/26 23:44:00 UTC

[jira] [Created] (SPARK-28879) Kubernetes node selector should be configurable

Franco created SPARK-28879:
------------------------------

             Summary: Kubernetes node selector should be configurable
                 Key: SPARK-28879
                 URL: https://issues.apache.org/jira/browse/SPARK-28879
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.4.3
            Reporter: Franco


Similar to SPARK-25220.

 

Having to create pod templates is not an answer because:

a) It's not available until Spark 3.0 which is unlikely to be deployed to platforms like EMR for a while as there will be major impacts to dependent libraries.

b) It is on overkill for something as fundamental as selecting different nodes for your workers as your drivers i.e. for Spot pricing.

 

Would request that we add this feature in the 2.4 timeframe.

 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org