You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/10 13:41:00 UTC
[jira] [Commented] (SPARK-25220) [K8S] Split out node selector
config between driver and executors.
[ https://issues.apache.org/jira/browse/SPARK-25220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16609208#comment-16609208 ]
Wenchen Fan commented on SPARK-25220:
-------------------------------------
I'm removing the target version, since it's trivial and we won't merge it to 2.4.
> [K8S] Split out node selector config between driver and executors.
> ------------------------------------------------------------------
>
> Key: SPARK-25220
> URL: https://issues.apache.org/jira/browse/SPARK-25220
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.4.0
> Reporter: Jonathan A Weaver
> Priority: Trivial
> Labels: Kubernetes
>
> Seperated node selector config option between executors and driver.
> This removes the spark.kubernetes.node.selector config option and seperates it to
> spark.kubernetes.driver.selector and spark.kubernetes.executor.selector
> to allow seperate node selectors on drivers and executors.
> My personal use case for this change is that on AWS we have cheap spotinstances that can terminate at any moment which is okay for executors but not the driver.
> With a single node selector option I am unable to use the spot instances to save costs on the executor nodes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org