You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2024/10/24 17:32:56 UTC

(spark) branch master updated: [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 95b2d27079c2 [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`
95b2d27079c2 is described below

commit 95b2d27079c2e012ab5bfb8c1dd83b11d7848258
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu Oct 24 10:32:45 2024 -0700

    [SPARK-50099][K8S][DOCS] Update `YuniKorn` docs with `1.6.0`
    
    ### What changes were proposed in this pull request?
    
    This PR aims to update `YuniKorn` docs with v1.6.0 for Apache Spark 4.0.0 (February 2025)
    
    ### Why are the changes needed?
    
    Apache YuniKorn v1.6.0 was released on 2024-09-17 with 316 [JIRAs](https://issues.apache.org/jira/issues/?filter=12352202) issues.
    
      - https://yunikorn.apache.org/release-announce/1.6.0/
    
    I installed YuniKorn v1.6.0 on K8s 1.30 and tested manually.
    
    **K8s v1.30**
    ```
    $ kubectl version
    Client Version: v1.31.1
    Kustomize Version: v5.4.2
    Server Version: v1.30.2
    ```
    
    **YuniKorn v1.6.0**
    ```
    $ helm list -n yunikorn
    NAME            NAMESPACE       REVISION        UPDATED                                 STATUS          CHART           APP VERSION
    yunikorn        yunikorn        1               2024-10-24 08:26:31.125617 -0700 PDT    deployed        yunikorn-1.6.0
    ```
    
    ```
    $ build/sbt -Pkubernetes -Pkubernetes-integration-tests -Dspark.kubernetes.test.deployMode=docker-desktop "kubernetes-integration-tests/testOnly *.YuniKornSuite" -Dtest.exclude.tags=minikube,local,decom,r -Dtest.default.exclude.tags=
    ...
    [info] YuniKornSuite:
    ...
    [info] Run completed in 6 minutes, 53 seconds.
    [info] Total number of tests run: 27
    [info] Suites: completed 1, aborted 0
    [info] Tests: succeeded 27, failed 0, canceled 2, ignored 1, pending 0
    [info] All tests passed.
    [success] Total time: 421 s (07:01), completed Oct 24, 2024, 8:50:17 AM
    ```
    
    ```
    │ Events:
    │   Type    Reason             Age   From      Message
    │   ----    ------             ----  ----      -------
    │   Normal  Scheduling         4s    yunikorn  spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver is queued and waiting for allocation                                                            │
    │   Normal  Scheduled          4s    yunikorn  Successfully assigned spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver to node docker-desktop                                                    │
    │   Normal  PodBindSuccessful  4s    yunikorn  Pod spark-d823525bd8cc4f80821b85dc065127b8/spark-test-app-432e49385adf454a97770227d49b8860-driver is successfully bound to node docker-desktop
    │   Normal  Pulled             4s    kubelet   Container image "docker.io/kubespark/spark:dev" already present on machine
    │   Normal  Created            4s    kubelet   Created container spark-kubernetes-driver
    │   Normal  Started            4s    kubelet   Started container spark-kubernetes-driver
    ```
    
    Closes #48639 from dongjoon-hyun/SPARK-50099.
    
    Authored-by: Dongjoon Hyun <do...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 docs/running-on-kubernetes.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index e7e9eb9ea4ff..7d6126edaa06 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -1988,10 +1988,10 @@ Install Apache YuniKorn:
 ```bash
 helm repo add yunikorn https://apache.github.io/yunikorn-release
 helm repo update
-helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.5.2 --create-namespace --set embedAdmissionController=false
+helm install yunikorn yunikorn/yunikorn --namespace yunikorn --version 1.6.0 --create-namespace --set embedAdmissionController=false
 ```
 
-The above steps will install YuniKorn v1.5.2 on an existing Kubernetes cluster.
+The above steps will install YuniKorn v1.6.0 on an existing Kubernetes cluster.
 
 ##### Get started
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org