You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/06/09 23:16:00 UTC
[jira] [Resolved] (SPARK-27334) Support specify scheduler name for
executor pods when submit
[ https://issues.apache.org/jira/browse/SPARK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-27334.
-----------------------------------
Resolution: Duplicate
Fix Version/s: 3.0.0
As [~Alexander_Fedosov] pointed out, please use pod template.
{code}
spec:
schedulerName: my-scheduler
{code}
> Support specify scheduler name for executor pods when submit
> ------------------------------------------------------------
>
> Key: SPARK-27334
> URL: https://issues.apache.org/jira/browse/SPARK-27334
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.4.0
> Reporter: TommyLike
> Priority: Major
> Labels: easyfix, features
> Fix For: 3.0.0
>
>
> Currently, there are some external schedulers which bring a lot a great value into kubernetes scheduling especially for HPC case, take a look at the *kube-batch* ([https://github.com/kubernetes-sigs/kube-batch]). In order to support it, we had to use Pod Template which seems cumbersome. It would be much convenient if this can be configured via option such as *"spark.kubernetes.executor.schedulerName"* just like others.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org