You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/06/06 03:48:18 UTC
[GitHub] [spark] attilapiros opened a new pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
attilapiros opened a new pull request #32793:
URL: https://github.com/apache/spark/pull/32793
NOT FOR MERGE / REVIEW: Investigation in progress!
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://spark.apache.org/contributing.html
2. Ensure you have added or run the appropriate tests for your PR: https://spark.apache.org/developer-tools.html
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][SPARK-XXXX] Your PR title ...'.
4. Be sure to keep the PR description updated to reflect all changes.
5. Please write your PR title to summarize what this PR proposes.
6. If possible, provide a concise example to reproduce the issue for a faster review.
7. If you want to add a new configuration, please read the guideline first for naming configurations in
'core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala'.
8. If you want to add or modify an error message, please read the guideline first:
https://spark.apache.org/error-message-guidelines.html
-->
### What changes were proposed in this pull request?
<!--
Please clarify what changes you are proposing. The purpose of this section is to outline the changes and how this PR fixes the issue.
If possible, please consider writing useful notes for better and faster reviews in your PR. See the examples below.
1. If you refactor some codes with changing classes, showing the class hierarchy will help reviewers.
2. If you fix some SQL features, you can provide some references of other DBMSes.
3. If there is design documentation, please add the link.
4. If there is a discussion in the mailing list, please add the link.
-->
### Why are the changes needed?
<!--
Please clarify why the changes are needed. For instance,
1. If you propose a new API, clarify the use case for a new API.
2. If you fix a bug, you can clarify why it is a bug.
-->
### Does this PR introduce _any_ user-facing change?
<!--
Note that it means *any* user-facing change including all aspects such as the documentation fix.
If yes, please clarify the previous behavior and the change this PR proposes - provide the console output, description and/or an example to show the behavior difference if possible.
If possible, please also clarify if this is a user-facing change compared to the released Spark versions or within the unreleased branches such as master.
If no, write 'No'.
-->
### How was this patch tested?
<!--
If tests were added, say they were added here. Please make sure to add some test cases that check the changes thoroughly including negative and positive cases if possible.
If it was tested in a way different from regular unit tests, please clarify how you tested step by step, ideally copy and paste-able, so that other reviewers can test and check, and descendants can verify in the future.
If tests were not added, please describe why they were not added and/or why it was difficult to add.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870188248
@dongjoon-hyun @shaneknapp to summarize my findings for running the "PVs with local storage":
1. The Jenkins job should be extended with creating of the Spark user on the Minikube node right after when the Minikube is started:
```
minikube ssh "sudo useradd spark -u 185 -g 0 -m -s /bin/bash"
```
2. And the mount should use the Spark user UID (185):
```
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
```
@shaneknapp may I ask you to run a test along this changes on the Jenkins servers?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855373853
**[Test build #139381 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139381/testReport)** for PR 32793 at commit [`9efa56d`](https://github.com/apache/spark/commit/9efa56d85c4346288b44c632b1a8c48935a47fe2).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855415382
**[Test build #139384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139384/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-890312358
> btw, we didn't need to run this command... when i tested locally, it worked fine by just adding the --uid and --gid flags to the minikube mount command.
This is great as those flags are already in the documentation in [Testing K8S
](https://github.com/apache/spark-website/blob/asf-site/developer-tools.md#testing-k8s) section:
```
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
```
So it ready to merge.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855375428
**[Test build #139381 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139381/testReport)** for PR 32793 at commit [`9efa56d`](https://github.com/apache/spark/commit/9efa56d85c4346288b44c632b1a8c48935a47fe2).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855341479
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43898/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889646458
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889444449
**[Test build #141856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141856/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870825358
**[Test build #140380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140380/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-891152996
> > thanks for pointing out this bit of the doc... i need to update it to reflect that use the docker (default) drivers now!
>
> On Linux. But on Mac because of the [limitation](https://docs.docker.com/docker-for-mac/networking/#per-container-ip-addressing-is-not-possible) I mentioned in the description docker driver won't work (test waits for interactive login at the test `Launcher client dependencies`).
got it. i'll create a PR for the docs and cc you on it... we'll try and cover as many OS permutations as reasonable. :)
anyways, i'm merging this to master now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889497331
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870832259
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140380/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889509402
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141858/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889326566
i'll start testing this today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870832193
**[Test build #140380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140380/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
* This patch **fails to build**.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855916867
I managed to reproduce the issue locally. I have some ideas how to proceed but my vacation is starting. I will be off for 10-11 days starting now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870188248
@dongjoon-hyun @shaneknapp to summarize my findings for running the "PVs with local storage":
1. The Jenkins job should be extended with creating of the Spark user on the Minikube node right after when the Minikube is started:
```
minikube ssh "sudo useradd spark -u 185 -g 0 -m -s /bin/bash"
```
2. And the mount should use the Spark user UID (185):
```
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
```
@shaneknapp may I ask you to run a test along this changes on the Jenkins servers?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855334374
**[Test build #139377 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139377/testReport)** for PR 32793 at commit [`f2de8b9`](https://github.com/apache/spark/commit/f2de8b9c9cea2d5aaed2ff4b5502eb79432d97af).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855403164
Kubernetes integration test unable to build dist.
exiting with code: 1
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855431378
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43905/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-890652188
thanks for pointing out this bit of the doc... i need to update it to
reflect that use the docker (default) drivers now!
On Sat, Jul 31, 2021 at 1:36 AM Attila Zsolt Piros ***@***.***>
wrote:
> btw, we didn't need to run this command... when i tested locally, it
> worked fine by just adding the --uid and --gid flags to the minikube mount
> command.
>
> This is great as those flags are already in the documentation in Testing
> K8S
>
> <https://github.com/apache/spark-website/blob/asf-site/developer-tools.md#testing-k8s>
> section:
>
> minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
>
> So it is ready to merge.
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/spark/pull/32793#issuecomment-890312358>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AAMIHLHGKPBOTQ4WILHP32DT2OYZ7ANCNFSM46FMA33A>
> .
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855431511
**[Test build #139385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139385/testReport)** for PR 32793 at commit [`b3201bb`](https://github.com/apache/spark/commit/b3201bbaebd37f69ac0023a03b8d611f907e344b).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889429643
test this please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855406039
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855417256
**[Test build #139384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139384/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855381699
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43902/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870984824
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855397752
**[Test build #139382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139382/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889544312
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46369/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889497120
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46367/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889468734
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46367/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855373853
**[Test build #139381 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139381/testReport)** for PR 32793 at commit [`9efa56d`](https://github.com/apache/spark/commit/9efa56d85c4346288b44c632b1a8c48935a47fe2).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870968933
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-875458517
@shaneknapp can you please take a look to this: https://github.com/apache/spark/pull/32793#issuecomment-870188248
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855437167
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43906/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889437958
**[Test build #141856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141856/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889646458
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141877/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros edited a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros edited a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855414509
The error unrelated. It is some JDK version difference I believe:
```
java.lang.NoSuchMethodError: java.nio.ByteBuffer.rewind()Ljava/nio/ByteBuffer;
```
Jenkins retest this please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855379963
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43902/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855433489
**[Test build #139385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139385/testReport)** for PR 32793 at commit [`b3201bb`](https://github.com/apache/spark/commit/b3201bbaebd37f69ac0023a03b8d611f907e344b).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855433538
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139385/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855381699
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43902/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855425433
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43905/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889509274
**[Test build #141858 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141858/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855442276
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43906/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855338930
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139377/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855433538
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889657259
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46386/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889509402
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141858/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855367651
```
Given path (/opt/spark/pv-tests/tmp4733047518020429989.txt) does not exist
```
In the Driver log:
```
21/06/05 22:19:26.628 ScalaTest-main-running-KubernetesSuite INFO KubernetesSuite: BEGIN driver POD log
++ id -u
+ myuid=185
++ id -g
+ mygid=0
+ set +e
++ getent passwd 185
+ uidentry=
+ set -e
+ '[' -z '' ']'
+ '[' -w /etc/passwd ']'
+ echo '185:x:185:0:anonymous uid:/opt/spark:/bin/false'
+ SPARK_CLASSPATH=':/opt/spark/jars/*'
+ env
+ grep SPARK_JAVA_OPT_
+ sort -t_ -k4 -n
+ sed 's/[^=]*=\(.*\)/\1/g'
+ readarray -t SPARK_EXECUTOR_JAVA_OPTS
+ '[' -n '' ']'
+ '[' -z ']'
+ '[' -z ']'
+ '[' -n '' ']'
+ '[' -z ']'
+ '[' -z x ']'
+ SPARK_CLASSPATH='/opt/spark/conf::/opt/spark/jars/*'
+ case "$1" in
+ shift 1
+ CMD=("$SPARK_HOME/bin/spark-submit" --conf "spark.driver.bindAddress=$SPARK_DRIVER_BIND_ADDRESS" --deploy-mode client "$@")
+ exec /usr/bin/tini -s -- /opt/spark/bin/spark-submit --conf spark.driver.bindAddress=172.17.0.3 --deploy-mode client --properties-file /opt/spark/conf/spark.properties --class org.apache.spark.examples.DFSReadWriteTest local:///opt/spark/examples/jars/spark-examples_2.12-3.2.0-SNAPSHOT.jar /opt/spark/pv-tests/tmp4733047518020429989.txt /opt/spark/pv-tests
21/06/06 05:16:29 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Given path (/opt/spark/pv-tests/tmp4733047518020429989.txt) does not exist
DFS Read-Write Test
Usage: localFile dfsDir
localFile - (string) local file to use in test
dfsDir - (string) DFS directory for read/write tests
log4j:WARN No appenders could be found for logger (org.apache.spark.util.ShutdownHookManager).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
21/06/05 22:19:26.628 ScalaTest-main-running-KubernetesSuite INFO KubernetesSuite: END driver POD log
```
So Driver was started.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855399933
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855431511
**[Test build #139385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139385/testReport)** for PR 32793 at commit [`b3201bb`](https://github.com/apache/spark/commit/b3201bbaebd37f69ac0023a03b8d611f907e344b).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855414509
The error unrelated. It is some JDK version difference I believe:
```
java.lang.NoSuchMethodError: java.nio.ByteBuffer.rewind()Ljava/nio/ByteBuffer;
```
Jenkins restest this please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855375482
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139381/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855334374
**[Test build #139377 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139377/testReport)** for PR 32793 at commit [`f2de8b9`](https://github.com/apache/spark/commit/f2de8b9c9cea2d5aaed2ff4b5502eb79432d97af).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889538096
Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46369/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889636494
If we got again:
```
- Test decommissioning with dynamic allocation & shuffle cleanups *** FAILED ***
The code passed to eventually never returned normally. Attempted 1206 times over 20.002175396783333 minutes. (DecommissionSuite.scala:120)
```
I look into that test too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros edited a comment on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros edited a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-890312358
> btw, we didn't need to run this command... when i tested locally, it worked fine by just adding the --uid and --gid flags to the minikube mount command.
This is great as those flags are already in the documentation in [Testing K8S
](https://github.com/apache/spark-website/blob/asf-site/developer-tools.md#testing-k8s) section:
```
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH} --9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
```
So it is ready to merge.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870985365
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889502947
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46367/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889672712
Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46386/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889519690
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46369/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855345555
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43898/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855399933
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139382/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-885074572
> @shaneknapp can you please take a look to this: [#32793 (comment)](https://github.com/apache/spark/pull/32793#issuecomment-870188248)
yeah, i can take a look. btw: best way to get in touch w/me? file a jira and assign it to me. ;)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855397752
**[Test build #139382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139382/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855423148
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139384/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889544312
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46369/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp closed pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp closed pull request #32793:
URL: https://github.com/apache/spark/pull/32793
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros edited a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros edited a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889636494
If we will get again:
```
- Test decommissioning with dynamic allocation & shuffle cleanups *** FAILED ***
The code passed to eventually never returned normally. Attempted 1206 times over 20.002175396783333 minutes. (DecommissionSuite.scala:120)
```
I look into that test too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889641117
**[Test build #141877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141877/testReport)** for PR 32793 at commit [`c777f80`](https://github.com/apache/spark/commit/c777f80830b81a5bac9e79151b9ac32dcb947da6).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855399893
**[Test build #139382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139382/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855338930
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139377/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889444604
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141856/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870825358
**[Test build #140380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140380/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855415382
**[Test build #139384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139384/testReport)** for PR 32793 at commit [`e7672ea`](https://github.com/apache/spark/commit/e7672ea6d7ae33056fe59ab233d76b7bbe750186).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855335352
**[Test build #139377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139377/testReport)** for PR 32793 at commit [`f2de8b9`](https://github.com/apache/spark/commit/f2de8b9c9cea2d5aaed2ff4b5502eb79432d97af).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870985365
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44903/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889636038
I have rebased it onto the top of master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-870832259
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140380/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889502947
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46367/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889503606
**[Test build #141858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141858/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855337350
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43898/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855447901
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43906/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855378974
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43902/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros edited a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros edited a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889636494
If we will get again:
```
- Test decommissioning with dynamic allocation & shuffle cleanups *** FAILED ***
The code passed to eventually never returned normally. Attempted 1206 times over 20.002175396783333 minutes. (DecommissionSuite.scala:120)
```
I'll look into that test too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889646337
**[Test build #141877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141877/testReport)** for PR 32793 at commit [`c777f80`](https://github.com/apache/spark/commit/c777f80830b81a5bac9e79151b9ac32dcb947da6).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855420632
Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43905/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] attilapiros commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
attilapiros commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-890769566
> thanks for pointing out this bit of the doc... i need to update it to reflect that use the docker (default) drivers now!
On Linux. But on Mac because of the [limitation](https://docs.docker.com/docker-for-mac/networking/#per-container-ip-addressing-is-not-possible) I mentioned in the description docker driver won't work (test waits for interactive login at the test `Launcher client dependencies`).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855423148
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139384/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889503606
**[Test build #141858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141858/testReport)** for PR 32793 at commit [`0f7d5fd`](https://github.com/apache/spark/commit/0f7d5fda9a9f1869c730065e4ad418e88b262a8d).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889641117
**[Test build #141877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141877/testReport)** for PR 32793 at commit [`c777f80`](https://github.com/apache/spark/commit/c777f80830b81a5bac9e79151b9ac32dcb947da6).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-891192691
see https://github.com/apache/spark-website/pull/351
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-889693406
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46386/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-891180974
Wow! Thank you, @attilapiros and @shaneknapp !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855431378
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43905/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855375482
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139381/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #32793: [SPARK-35430][K8S] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-890033626
> ```
> minikube ssh "sudo useradd spark -u 185 -g 0 -m -s /bin/bash"
> ```
>
btw, we didn't need to run this command... when i tested locally, it worked fine by just adding the `--uid` and `--gid` flags to the `minikube mount` command.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #32793: [WIP][SPARK-35430] Switch on "PVs with local storage" integration test on Docker driver
Posted by GitBox <gi...@apache.org>.
AmplabJenkins removed a comment on pull request #32793:
URL: https://github.com/apache/spark/pull/32793#issuecomment-855345555
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/43898/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org