You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/08/03 14:55:56 UTC
(spark) branch master updated: [SPARK-53079][K8S][DOCS] Update `YuniKorn` docs with `1.7.0`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 21fd32536265 [SPARK-53079][K8S][DOCS] Update `YuniKorn` docs with `1.7.0`
21fd32536265 is described below
commit 21fd325362658e284218118803cad532f6d8cc53
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sun Aug 3 07:55:45 2025 -0700
[SPARK-53079][K8S][DOCS] Update `YuniKorn` docs with `1.7.0`
### What changes were proposed in this pull request?
This PR aims to recommend `YuniKorn` v1.7.0 for Apache Spark 4.1.0 documentation.
### Why are the changes needed?
Apache YuniKorn v1.7.0 is a new feature release with 169 patches.
- https://issues.apache.org/jira/projects/YUNIKORN/versions/12354201
I installed YuniKorn v1.7.0 on K8s 1.32 and tested manually.
**K8s v1.32**
```
$ kubectl version
Client Version: v1.33.3
Kustomize Version: v5.6.0
Server Version: v1.32.2
```
**YuniKorn v1.7.0**
```
$ helm list -n yunikorn
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION
yunikorn yunikorn 1 2025-08-02 14:01:37.266418 -0700 PDT deployed yunikorn-1.7.0
```
```
$ build/sbt -Pkubernetes -Pkubernetes-integration-tests -Dspark.kubernetes.test.deployMode=docker-desktop "kubernetes-integration-tests/testOnly *.YuniKornSuite" -Dtest.exclude.tags=minikube,local,decom,r -Dtest.default.exclude.tags=
...
[info] YuniKornSuite:
[info] - SPARK-42190: Run SparkPi with local[*] (7 seconds, 20 milliseconds)
[info] - Run SparkPi with no resources (9 seconds, 991 milliseconds)
[info] - Run SparkPi with no resources & statefulset allocation (10 seconds, 178 milliseconds)
[info] - Run SparkPi with a very long application name. (10 seconds, 38 milliseconds)
[info] - Use SparkLauncher.NO_RESOURCE (9 seconds, 941 milliseconds)
...
[info] All tests passed.
[success] Total time: 432 s (07:12), completed Aug 2, 2025, 2:20:12 PM
```
```
Normal Scheduling 2s yunikorn spark-*-driver is queued and waiting for allocation
Normal Scheduled 2s yunikorn Successfully assigned spark-*-driver to node docker-desktop
Normal PodBindSuccessful 2s yunikorn Pod spark-*-driver is successfully bound to node docker-desktop
```
Closes #51791 from dongjoon-hyun/SPARK-53079.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/running-on-kubernetes.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index e2bf48e06278..9207b958f30b 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -1991,10 +1991,10 @@ Install Apache YuniKorn:
```bash
helm repo add yunikorn https://apache.github.io/yunikorn-release
helm repo update
-helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.6.3 --create-namespace --set embedAdmissionController=false
+helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.7.0 --create-namespace --set embedAdmissionController=false
```
-The above steps will install YuniKorn v1.6.3 on an existing Kubernetes cluster.
+The above steps will install YuniKorn v1.7.0 on an existing Kubernetes cluster.
##### Get started
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org