You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2024/09/04 17:10:34 UTC
[PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
dongjoon-hyun opened a new pull request, #47990:
URL: https://github.com/apache/spark/pull/47990
### What changes were proposed in this pull request?
This PR aims to update K8s docs to recommend K8s v1.28+ for Apache Spark 4.0.0.
This is a kind of follow-up of the following previous PR because Apache Spark 4.0.0 schedule is delayed slightly.
- #46168
### Why are the changes needed?
**1. K8s community starts to release v1.31.0 from 2024-04-17.**
- https://kubernetes.io/releases/#release-v1-30
**2. Default K8s Version in Public Cloud environments**
The default K8s versions of public cloud providers are already K8s 1.27+.
- EKS: v1.29 (Default)
- GKE: v1.29 (Rapid), v1.28 (Regular), v1.27 (Stable)
- AKS: v1.27
**3. End Of Support**
In addition, K8s 1.26 is going to reach EOL when Apache Spark 4.0.0 arrives because K8s 1.26 is also going to reach EOL on June.
| K8s | AKS | GKE | EKS |
| ---- | ------- | ------- | ------- |
| 1.26 | 2024-03 | 2024-06 | 2024-06 |
- [AKS EOL Schedule](https://docs.microsoft.com/en-us/azure/aks/supported-kubernetes-versions?tabs=azure-cli#aks-kubernetes-release-calendar)
- [GKE EOL Schedule](https://cloud.google.com/kubernetes-engine/docs/release-schedule)
- [EKS EOL Schedule](https://docs.aws.amazon.com/eks/latest/userguide/kubernetes-versions.html#kubernetes-release-calendar)
### Does this PR introduce _any_ user-facing change?
- No, this is a documentation-only change about K8s versions.
- Apache Spark K8s Integration Test is currently using K8s v1.30.0 on Minikube already.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on PR #47990:
URL: https://github.com/apache/spark/pull/47990#issuecomment-2330435963
Thank you, @HyukjinKwon .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on PR #47990:
URL: https://github.com/apache/spark/pull/47990#issuecomment-2329956327
Could you review this PR too, @viirya ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #47990:
URL: https://github.com/apache/spark/pull/47990#issuecomment-2330357252
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org>.
dongjoon-hyun commented on PR #47990:
URL: https://github.com/apache/spark/pull/47990#issuecomment-2330060161
Thank you, @viirya !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on PR #47990:
URL: https://github.com/apache/spark/pull/47990#issuecomment-2330032113
Looks good to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon closed pull request #47990: [SPARK-49512][K8S][DOCS] Drop K8s v1.27 Support
URL: https://github.com/apache/spark/pull/47990
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org