You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/11/08 03:34:28 UTC
[GitHub] [spark] dongjoon-hyun opened a new pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
dongjoon-hyun opened a new pull request #34511:
URL: https://github.com/apache/spark/pull/34511
### What changes were proposed in this pull request?
This PR aims to upgrade `kubenetes-client` from 5.8.0 to 5.9.0.
### Why are the changes needed?
This will bring the following bug fixes and improvement.
- https://github.com/fabric8io/kubernetes-client/releases/tag/v5.9.0
### Does this PR introduce _any_ user-facing change?
No. (The supported K8s versions are identical with 5.8.0).
### How was this patch tested?
Pass the CIs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962788234
**[Test build #144976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144976/testReport)** for PR 34511 at commit [`97e06c0`](https://github.com/apache/spark/commit/97e06c089f0601a052bf26f18b0d157978c6a137).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962931399
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49462/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962811845
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49447/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962862599
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49454/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962897022
**[Test build #144990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144990/testReport)** for PR 34511 at commit [`634fe17`](https://github.com/apache/spark/commit/634fe17aba7d797033e4de76e551fcc023837706).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962808653
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49447/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962884861
This seems to be the root cause at 2.13.0
- https://github.com/FasterXML/jackson-dataformats-text/commit/e5dc40f55321161c94b4d1088a030cf9de936497
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962937150
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49463/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963474916
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145006/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962899023
**[Test build #144991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144991/testReport)** for PR 34511 at commit [`213b752`](https://github.com/apache/spark/commit/213b752915fe9f6389fd15ef9f6f204504a353a2).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962994349
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144990/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963298889
**[Test build #145006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145006/testReport)** for PR 34511 at commit [`8e6a637`](https://github.com/apache/spark/commit/8e6a637da4ff019f723ce06ee92c61e673320068).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963452535
**[Test build #145006 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145006/testReport)** for PR 34511 at commit [`8e6a637`](https://github.com/apache/spark/commit/8e6a637da4ff019f723ce06ee92c61e673320068).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962810942
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49447/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962852793
**[Test build #144976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144976/testReport)** for PR 34511 at commit [`97e06c0`](https://github.com/apache/spark/commit/97e06c089f0601a052bf26f18b0d157978c6a137).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962885771
Let me update it and run together to see the Jackson upgrade feasibility.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962897022
**[Test build #144990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144990/testReport)** for PR 34511 at commit [`634fe17`](https://github.com/apache/spark/commit/634fe17aba7d797033e4de76e551fcc023837706).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962899023
**[Test build #144991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144991/testReport)** for PR 34511 at commit [`213b752`](https://github.com/apache/spark/commit/213b752915fe9f6389fd15ef9f6f204504a353a2).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963032638
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144991/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] sarutak commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
sarutak commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962885507
Yeah, I also confirmed it depends on Jackson `2.13.0`.
https://mvnrepository.com/artifact/io.fabric8/kubernetes-client/5.9.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963414048
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49479/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962788234
**[Test build #144976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144976/testReport)** for PR 34511 at commit [`97e06c0`](https://github.com/apache/spark/commit/97e06c089f0601a052bf26f18b0d157978c6a137).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962857410
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49454/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #34511:
URL: https://github.com/apache/spark/pull/34511#discussion_r744472561
##########
File path: dev/deps/spark-deps-hadoop-2.7-hive-2.3
##########
@@ -74,6 +74,7 @@ hadoop-annotations/2.7.4//hadoop-annotations-2.7.4.jar
hadoop-auth/2.7.4//hadoop-auth-2.7.4.jar
hadoop-aws/2.7.4//hadoop-aws-2.7.4.jar
hadoop-azure/2.7.4//hadoop-azure-2.7.4.jar
+hadoop-client-api/3.3.1//hadoop-client-api-3.3.1.jar
Review comment:
Surprisingly, when I update Jackson, this appears. This should not be here. I will investigate this separately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962843140
Thank you, @sarutak !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963360686
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49479/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962862580
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49454/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962881303
Although the UT passed, K8s integration seems to hit Jackson incompatibility issue. I'll take a look
```
KubernetesSuite:
*** RUN ABORTED ***
java.lang.NoSuchMethodError: com.fasterxml.jackson.dataformat.yaml.YAMLFactory._createContentReference(Ljava/lang/Object;)Lcom/fasterxml/jackson/core/io/ContentReference;
at com.fasterxml.jackson.dataformat.yaml.YAMLFactory.createParser(YAMLFactory.java:374)
at com.fasterxml.jackson.dataformat.yaml.YAMLFactory.createParser(YAMLFactory.java:348)
at com.fasterxml.jackson.dataformat.yaml.YAMLFactory.createParser(YAMLFactory.java:15)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3548)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3516)
at io.fabric8.kubernetes.client.internal.KubeConfigUtils.parseConfigFromString(KubeConfigUtils.java:47)
at io.fabric8.kubernetes.client.Config.loadFromKubeconfig(Config.java:591)
at io.fabric8.kubernetes.client.Config.tryKubeConfig(Config.java:557)
at io.fabric8.kubernetes.client.Config.autoConfigure(Config.java:279)
at io.fabric8.kubernetes.client.Config.<init>(Config.java:245)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962936574
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144983/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962967034
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49462/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963027032
**[Test build #144991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144991/testReport)** for PR 34511 at commit [`213b752`](https://github.com/apache/spark/commit/213b752915fe9f6389fd15ef9f6f204504a353a2).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962902679
I spun off the Jackson part to SPARK-37241 as a blocker for this PR (SPARK-37237).
- https://github.com/apache/spark/pull/34516
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963421528
The last commit is the same with the approved commit because Jackson upgrade is handled via another PR. I'll merge this, @sarutak . Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963421528
The last commit is the same with the approved commit because Jackson upgrade is handled via another PR. I'll merge this, @sarutak .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963414048
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49479/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962860870
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144976/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #34511:
URL: https://github.com/apache/spark/pull/34511#discussion_r744472561
##########
File path: dev/deps/spark-deps-hadoop-2.7-hive-2.3
##########
@@ -74,6 +74,7 @@ hadoop-annotations/2.7.4//hadoop-annotations-2.7.4.jar
hadoop-auth/2.7.4//hadoop-auth-2.7.4.jar
hadoop-aws/2.7.4//hadoop-aws-2.7.4.jar
hadoop-azure/2.7.4//hadoop-azure-2.7.4.jar
+hadoop-client-api/3.3.1//hadoop-client-api-3.3.1.jar
Review comment:
Surprisingly, when I update Jackson, this appears. I will investigate this separately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on a change in pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on a change in pull request #34511:
URL: https://github.com/apache/spark/pull/34511#discussion_r744472561
##########
File path: dev/deps/spark-deps-hadoop-2.7-hive-2.3
##########
@@ -74,6 +74,7 @@ hadoop-annotations/2.7.4//hadoop-annotations-2.7.4.jar
hadoop-auth/2.7.4//hadoop-auth-2.7.4.jar
hadoop-aws/2.7.4//hadoop-aws-2.7.4.jar
hadoop-azure/2.7.4//hadoop-azure-2.7.4.jar
+hadoop-client-api/3.3.1//hadoop-client-api-3.3.1.jar
Review comment:
~Surprisingly, when I update Jackson, this appears. This should not be here. I will investigate this separately.~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962925508
**[Test build #144983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144983/testReport)** for PR 34511 at commit [`f09c2e3`](https://github.com/apache/spark/commit/f09c2e3a26d385538e770a549b10b9033988131f).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962984078
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49463/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963298889
**[Test build #145006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145006/testReport)** for PR 34511 at commit [`8e6a637`](https://github.com/apache/spark/commit/8e6a637da4ff019f723ce06ee92c61e673320068).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963474916
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145006/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962860870
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144976/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962811845
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49447/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962834748
**[Test build #144983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144983/testReport)** for PR 34511 at commit [`f09c2e3`](https://github.com/apache/spark/commit/f09c2e3a26d385538e770a549b10b9033988131f).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962936574
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/144983/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962992771
**[Test build #144990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144990/testReport)** for PR 34511 at commit [`634fe17`](https://github.com/apache/spark/commit/634fe17aba7d797033e4de76e551fcc023837706).
* This patch **fails Spark unit tests**.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962994349
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun closed pull request #34511:
URL: https://github.com/apache/spark/pull/34511
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963400732
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49479/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962984482
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962984484
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962902679
I spun off the Jackson part to SPARK-37241 .
- https://github.com/apache/spark/pull/34516
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-963420393
All test passed except 2 K8s integration test cases.
```
KubernetesSuite:
- Run SparkPi with no resources
- Run SparkPi with no resources & statefulset allocation
- Run SparkPi with a very long application name.
- Use SparkLauncher.NO_RESOURCE
- Run SparkPi with a master URL without a scheme.
- Run SparkPi with an argument.
- Run SparkPi with custom labels, annotations, and environment variables.
- All pods have the same service account by default
- Run extraJVMOptions check on driver
- Run SparkRemoteFileTest using a remote data file
- Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties
- Run SparkPi with env and mount secrets.
- Run PySpark on simple pi.py example
- Run PySpark to test a pyfiles example
- Run PySpark with memory customization
- Run in client mode.
- Start pod creation from template
- PVs with local hostpath storage on statefulsets
- PVs with local hostpath and storageClass on statefulsets
- PVs with local storage
- Launcher client dependencies
- SPARK-33615: Launcher client archives
- SPARK-33748: Launcher python client respecting PYSPARK_PYTHON
- SPARK-33748: Launcher python client respecting spark.pyspark.python and spark.pyspark.driver.python
- Launcher python client dependencies using a zip file
- Test basic decommissioning
- Test basic decommissioning with shuffle cleanup
- Test decommissioning with dynamic allocation & shuffle cleanups *** FAILED ***
- Test decommissioning timeouts
- Run SparkR on simple dataframe.R example *** FAILED ***
Run completed in 33 minutes, 17 seconds.
Total number of tests run: 30
Suites: completed 2, aborted 0
Tests: succeeded 28, failed 2, canceled 0, ignored 0, pending 0
*** 2 TESTS FAILED ***
```
This is not a regression because the master branch has it already (https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49466/)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun edited a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962885771
Let me update it and run together to see the Jackson upgrade feasibility because Jackson is tricky.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962862599
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49454/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #34511: [SPARK-37237][K8S][BUILD] Upgrade kubernetes-client to 5.9.0
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #34511:
URL: https://github.com/apache/spark/pull/34511#issuecomment-962834748
**[Test build #144983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/144983/testReport)** for PR 34511 at commit [`f09c2e3`](https://github.com/apache/spark/commit/f09c2e3a26d385538e770a549b10b9033988131f).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org