You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2022/01/25 00:53:02 UTC
[spark] branch master updated: [SPARK-38007][K8S][DOCS] Update K8s doc to recommend K8s 1.20+
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new e362ef1 [SPARK-38007][K8S][DOCS] Update K8s doc to recommend K8s 1.20+
e362ef1 is described below
commit e362ef17e20a5a3957b4b03949940b7787462b42
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Mon Jan 24 16:52:15 2022 -0800
[SPARK-38007][K8S][DOCS] Update K8s doc to recommend K8s 1.20+
### What changes were proposed in this pull request?
This PR aims to update K8s `Prerequisites` doc to recommend K8s 1.20+ and to remove `Spark 2.3`.
### Why are the changes needed?
The AS-IS document is outdated because it's written 4 years ago.
- kubernetes-client 4.1.1 dropped K8s 1.6 and 1.7 support. (https://github.com/fabric8io/kubernetes-client)
- kubernetes-client 5.8.0 dropped K8s 1.9 support. (https://github.com/fabric8io/kubernetes-client)
- EKS also makes the following EOLs (https://docs.aws.amazon.com/eks/latest/userguide/kubernetes-versions.html)
- 1.16 (September 27, 2021)
- 1.17 (November 2, 2021)
- 1.18 (March 31, 2022)
- 1.19 (April, 2022)
- MKS has the similar status (https://docs.microsoft.com/en-us/azure/aks/supported-kubernetes-versions?tabs=azure-cli#aks-kubernetes-release-calendar)
### Does this PR introduce _any_ user-facing change?
No. This is a documentation change.
### How was this patch tested?
Manual.
Closes #35306 from dongjoon-hyun/SPARK-38007.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
docs/running-on-kubernetes.md | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md
index b869951..b9355c3 100644
--- a/docs/running-on-kubernetes.md
+++ b/docs/running-on-kubernetes.md
@@ -44,8 +44,7 @@ Cluster administrators should use [Pod Security Policies](https://kubernetes.io/
# Prerequisites
-* A runnable distribution of Spark 2.3 or above.
-* A running Kubernetes cluster at version >= 1.6 with access configured to it using
+* A running Kubernetes cluster at version >= 1.20 with access configured to it using
[kubectl](https://kubernetes.io/docs/user-guide/prereqs/). If you do not already have a working Kubernetes cluster,
you may set up a test cluster on your local machine using
[minikube](https://kubernetes.io/docs/getting-started-guides/minikube/).
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org