You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/10/24 19:26:00 UTC
[jira] [Resolved] (SPARK-36057) SPIP: Support Customized Kubernetes Schedulers
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-36057.
-----------------------------------
Fix Version/s: 3.3.1
Resolution: Done
Since Apache Spark 3.3.1, Apache Spark community officially support Volcano and YuniKorn schedulers.
> SPIP: Support Customized Kubernetes Schedulers
> ----------------------------------------------
>
> Key: SPARK-36057
> URL: https://issues.apache.org/jira/browse/SPARK-36057
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Holden Karau
> Priority: Major
> Labels: SPIP
> Fix For: 3.3.1
>
>
> This is an umbrella issue for tracking the work for supporting Volcano & Yunikorn on Kubernetes. These schedulers provide more YARN like features (such as queues and minimum resources before scheduling jobs) that many folks want on Kubernetes.
>
> Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
>
> They've taken slightly different approaches to solving the same problem, but from Spark's point of view we should be able to share much of the code.
>
> See the initial brainstorming discussion in SPARK-35623.
>
> DISCUSSION: [https://lists.apache.org/thread/zv3o62xrob4dvgkbftbv5w5wy75hkbxg]
> VOTE: [https://lists.apache.org/thread/cz3cpp8q4pgmh7h35h6lvkwf6g3lwhcd]
> VOTE Result: [https://lists.apache.org/thread/nvwfo0yo0q8997vs86o7wkjyby4tbp0m]
> Design DOC: [https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
> Recap slide: [https://lists.apache.org/thread/mwswfwkycj71npwz8gmv1r5nrvpwj77s]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org