You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2024/10/24 17:32:56 UTC
(spark) branch master updated: [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 95b2d27079c2 [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`
95b2d27079c2 is described below
commit 95b2d27079c2e012ab5bfb8c1dd83b11d7848258
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu Oct 24 10:32:45 2024 -0700
[SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`
### What changes were proposed in this pull request?
This PR aims to update `YuniKorn` docs with v1.6.0 for Apache Spark 4.0.0 (February 2025)
### Why are the changes needed?
Apache YuniKorn v1.6.0 was released on 2024-09-17 with 316 [JIRAs](https://issues.apache.org/jira/issues/?filter=12352202) issues.
- https://yunikorn.apache.org/release-announce/1.6.0/
I installed YuniKorn v1.6.0 on K8s 1.30 and tested manually.
**K8s v1.30**
```
$ kubectl version
Client Version: v1.31.1
Kustomize Version: v5.4.2
Server Version: v1.30.2
```
**YuniKorn v1.6.0**
```
$ helm list -n yunikorn
NAME NAMESPACE REVISION UPDATED STATUS CHART APP VERSION
yunikorn yunikorn 1 2024-10-24 08:26:31.125617 -0700 PDT deployed yunikorn-1.6.0
```
```
$ build/sbt -Pkubernetes -Pkubernetes-integration-tests -Dspark.kubernetes.test.deployMode=docker-desktop "kubernetes-integration-tests/testOnly *.YuniKornSuite" -Dtest.exclude.tags=minikube,local,decom,r -Dtest.default.exclude.tags=
...
[info] YuniKornSuite:
...
[info] Run completed in 6 minutes, 53 seconds.
[info] Total number of tests run: 27
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 27, failed 0, canceled 2, ignored 1, pending 0
[info] All tests passed.
[success] Total time: 421 s (07:01), completed Oct 24, 2024, 8:50:17 AM
```
```
│ Events:
│ Type Reason Age From Message
│ ---- ------ ---- ---- -------
│ Normal Scheduling 4s yunikorn spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver is queued and waiting for allocation │
│ Normal Scheduled 4s yunikorn Successfully assigned spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver to node docker-desktop │
│ Normal PodBindSuccessful 4s yunikorn Pod spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver is successfully bound to node docker-desktop
│ Normal Pulled 4s kubelet Container image "docker.io/kubespark/spark:dev" already present on machine
│ Normal Created 4s kubelet Created container spark-kubernetes-driver
│ Normal Started 4s kubelet Started container spark-kubernetes-driver
```
Closes #48639 from dongjoon-hyun/SPARK-50099.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/running-on-kubernetes.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index e7e9eb9ea4ff..7d6126edaa06 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -1988,10 +1988,10 @@ Install Apache YuniKorn:
```bash
helm repo add yunikorn https://apache.github.io/yunikorn-release
helm repo update
-helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.5.2 --create-namespace --set embedAdmissionController=false
+helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.6.0 --create-namespace --set embedAdmissionController=false
```
-The above steps will install YuniKorn v1.5.2 on an existing Kubernetes cluster.
+The above steps will install YuniKorn v1.6.0 on an existing Kubernetes cluster.
##### Get started
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org