You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yikun Jiang (Jira)" <ji...@apache.org> on 2022/02/24 03:53:00 UTC
[jira] [Updated] (SPARK-36057) Support Customized Kubernetes Schedulers
[ https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yikun Jiang updated SPARK-36057:
--------------------------------
Description:
This is an umbrella issue for tracking the work for supporting Volcano & Yunikorn on Kubernetes. These schedulers provide more YARN like features (such as queues and minimum resources before scheduling jobs) that many folks want on Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
DISCUSSION: [https://lists.apache.org/thread/zv3o62xrob4dvgkbftbv5w5wy75hkbxg]
VOTE: [https://lists.apache.org/thread/cz3cpp8q4pgmh7h35h6lvkwf6g3lwhcd]
VOTE Result: [https://lists.apache.org/thread/nvwfo0yo0q8997vs86o7wkjyby4tbp0m]
Design DOC: [https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
Recap slide: [https://lists.apache.org/thread/mwswfwkycj71npwz8gmv1r5nrvpwj77s]
was:
This is an umbrella issue for tracking the work for supporting Volcano & Yunikorn on Kubernetes. These schedulers provide more YARN like features (such as queues and minimum resources before scheduling jobs) that many folks want on Kubernetes.
Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
They've taken slightly different approaches to solving the same problem, but from Spark's point of view we should be able to share much of the code.
See the initial brainstorming discussion in SPARK-35623.
Google DOC:
[https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
> Support Customized Kubernetes Schedulers
> ----------------------------------------
>
> Key: SPARK-36057
> URL: https://issues.apache.org/jira/browse/SPARK-36057
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.3.0
> Reporter: Holden Karau
> Priority: Major
>
> This is an umbrella issue for tracking the work for supporting Volcano & Yunikorn on Kubernetes. These schedulers provide more YARN like features (such as queues and minimum resources before scheduling jobs) that many folks want on Kubernetes.
>
> Yunikorn is an ASF project & Volcano is a CNCF project (sig-batch).
>
> They've taken slightly different approaches to solving the same problem, but from Spark's point of view we should be able to share much of the code.
>
> See the initial brainstorming discussion in SPARK-35623.
>
> DISCUSSION: [https://lists.apache.org/thread/zv3o62xrob4dvgkbftbv5w5wy75hkbxg]
> VOTE: [https://lists.apache.org/thread/cz3cpp8q4pgmh7h35h6lvkwf6g3lwhcd]
> VOTE Result: [https://lists.apache.org/thread/nvwfo0yo0q8997vs86o7wkjyby4tbp0m]
> Design DOC: [https://docs.google.com/document/d/1xgQGRpaHQX6-QH_J9YV2C2Dh6RpXefUpLM7KGkzL6Fg]
> Recap slide: [https://lists.apache.org/thread/mwswfwkycj71npwz8gmv1r5nrvpwj77s]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org