You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2023/02/24 02:04:24 UTC
[spark] branch branch-3.4 updated: [SPARK-42545][K8S][DOCS] Remove `experimental` from `Volcano` docs
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new 4fb30f74f3f [SPARK-42545][K8S][DOCS] Remove `experimental` from `Volcano` docs
4fb30f74f3f is described below
commit 4fb30f74f3f49110a5e3bc8c73da7ac3b397a7cf
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu Feb 23 18:04:00 2023 -0800
[SPARK-42545][K8S][DOCS] Remove `experimental` from `Volcano` docs
### What changes were proposed in this pull request?
This PR aims to remove `experimental` notes from `Volcano` docs.
### Why are the changes needed?
Apache Spark 3.3.0 added `Volcano` as an experimental module. Now, we can remove it from Apache Spark 3.4.0 because we don't expect breaking future behavior changes.
### Does this PR introduce _any_ user-facing change?
No, this is a documentation only change.
### How was this patch tested?
Manual review.
Closes #40152 from dongjoon-hyun/SPARK-42545.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit be745f7f3b0b970cf385e7d8cc2be42c340fd1d6)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/running-on-kubernetes.md | 2 --
resource-managers/kubernetes/integration-tests/README.md | 2 --
2 files changed, 4 deletions(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index 56129d38d15..e580beb8ad6 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -1845,8 +1845,6 @@ Spark allows users to specify a custom Kubernetes schedulers.
#### Using Volcano as Customized Scheduler for Spark on Kubernetes
-**This feature is currently experimental. In future versions, there may be behavioral changes around configuration, feature step improvement.**
-
##### Prerequisites
* Spark on Kubernetes with [Volcano](https://volcano.sh/en) as a custom scheduler is supported since Spark v3.3.0 and Volcano v1.7.0. Below is an example to install Volcano 1.7.0:
diff --git a/resource-managers/kubernetes/integration-tests/README.md b/resource-managers/kubernetes/integration-tests/README.md
index 0a03be42b4b..b85e57db768 100644
--- a/resource-managers/kubernetes/integration-tests/README.md
+++ b/resource-managers/kubernetes/integration-tests/README.md
@@ -331,8 +331,6 @@ You can also specify your specific dockerfile to build JVM/Python/R based image
# Running the Volcano Integration Tests
-Volcano integration is experimental in Aapche Spark 3.3.0 and the test coverage is limited.
-
## Requirements
- A minimum of 6 CPUs and 9G of memory is required to complete all Volcano test cases.
- Volcano v1.7.0.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org