[jira] [Created] (SPARK-39025) Add k8s Scheduling, Preemption and Eviction feature to apache spark

["qian (Jira)" <ji...@apache.org>]

qian created SPARK-39025:
----------------------------

             Summary: Add k8s Scheduling, Preemption and Eviction feature to apache spark
                 Key: SPARK-39025
                 URL: https://issues.apache.org/jira/browse/SPARK-39025
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.2.1
            Reporter: qian
             Fix For: 3.4.0


As [https://kubernetes.io/docs/concepts/scheduling-eviction/] show, apache spark lacks of support for k8s scheduling, preemption and eviction.

This issue wants to support toleration/priorityClass/runtimeClass etc , more information please refer 

[https://kubernetes.io/docs/concepts/scheduling-eviction/] 

[https://kubernetes.io/docs/concepts/scheduling-eviction/kube-scheduler/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/pod-priority-preemption/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/node-pressure-eviction/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/api-eviction/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/resource-bin-packing/]

[https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/]

https://kubernetes.io/docs/concepts/scheduling-eviction/scheduler-perf-tuning/



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org