You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/05/07 23:24:51 UTC
(spark) branch branch-4.0 updated: [SPARK-52027][K8S][DOCS] Update `YuniKorn` docs with `1.6.3`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.0 by this push:
new 14225cb55baf [SPARK-52027][K8S][DOCS] Update `YuniKorn` docs with `1.6.3`
14225cb55baf is described below
commit 14225cb55baf739f1f41090aa44cb207ecf711df
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Wed May 7 16:24:34 2025 -0700
[SPARK-52027][K8S][DOCS] Update `YuniKorn` docs with `1.6.3`
### What changes were proposed in this pull request?
This PR aims to update `YuniKorn` docs with v1.6.3 for Apache Spark 4.0.0.
### Why are the changes needed?
Apache YuniKorn v1.6.3 was released on 2025-05-06 with 1 [JIRAs](https://yunikorn.apache.org/release-announce/1.6.3) issue.
- https://yunikorn.apache.org/release-announce/1.6.3/
- https://github.com/apache/yunikorn-core/pull/1007
I installed YuniKorn v1.6.3 on K8s 1.32 and tested manually.
**K8s v1.32**
```
$ kubectl version
Client Version: v1.33.0
Kustomize Version: v5.6.0
Server Version: v1.32.2
```
**YuniKorn v1.6.3**
```
$ helm list -n yunikorn
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION
yunikorn yunikorn 1 2025-05-07 14:07:05.198259 -0700 PDT deployed yunikorn-1.6.3
```
```
$ build/sbt -Pkubernetes -Pkubernetes-integration-tests -Dspark.kubernetes.test.deployMode=docker-desktop "kubernetes-integration-tests/testOnly *.YuniKornSuite" -Dtest.exclude.tags=minikube,local,decom,r -Dtest.default.exclude.tags=
...
[info] YuniKornSuite:
[info] - SPARK-42190: Run SparkPi with local[*] (8 seconds, 446 milliseconds)
[info] - Run SparkPi with no resources (12 seconds, 700 milliseconds)
[info] - Run SparkPi with no resources & statefulset allocation (12 seconds, 669 milliseconds)
[info] - Run SparkPi with a very long application name. (11 seconds, 759 milliseconds)
...
[info] All tests passed.
[success] Total time: 482 s (08:02), completed May 7, 2025, 2:21:08 PM
```
```
Normal Scheduling 2s yunikorn spark-e21673d6768f420989481181243e555f/spark-test-app-77 ..
```
Closes #50818 from dongjoon-hyun/SPARK-52027.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit f68452d48f03aa1f872291be697b5ec91b91af54)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/running-on-kubernetes.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index 9b06524cd366..d43dba41c11b 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -1988,10 +1988,10 @@ Install Apache YuniKorn:
```bash
helm repo add yunikorn https://apache.github.io/yunikorn-release
helm repo update
-helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.6.2 --create-namespace --set embedAdmissionController=false
+helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.6.3 --create-namespace --set embedAdmissionController=false
```
-The above steps will install YuniKorn v1.6.2 on an existing Kubernetes cluster.
+The above steps will install YuniKorn v1.6.3 on an existing Kubernetes cluster.
##### Get started
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org