You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/05/16 20:39:00 UTC
[jira] [Assigned] (SPARK-27754) Introduce spark on k8s config for
driver request cores
[ https://issues.apache.org/jira/browse/SPARK-27754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-27754:
------------------------------------
Assignee: Apache Spark
> Introduce spark on k8s config for driver request cores
> ------------------------------------------------------
>
> Key: SPARK-27754
> URL: https://issues.apache.org/jira/browse/SPARK-27754
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.0.0
> Reporter: Arun Mahadevan
> Assignee: Apache Spark
> Priority: Minor
>
> Spark on k8s supports config for specifying the executor cpu requests
> (spark.kubernetes.executor.request.cores) but a similar config is missing
> for the driver. Apparently `spark.driver.cores` works but its not evident that this accepts
> fractional values (its defined as an Integer config but apparently accepts decimals). To keep in sync
> with the executor config a similar driver config can be
> introduced (spark.kubernetes.driver.request.cores) for explicitly specifying
> the driver CPU requests. If not provided, the value will default to `spark.driver.cores` as before.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org