You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/11/25 23:00:16 UTC
[GitHub] [spark] shaneknapp opened a new pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
shaneknapp opened a new pull request #30509:
URL: https://github.com/apache/spark/pull/30509
<!--
Thanks for sending a pull request! Here are some tips for you:
1. If this is your first time, please read our contributor guidelines: https://spark.apache.org/contributing.html
2. Ensure you have added or run the appropriate tests for your PR: https://spark.apache.org/developer-tools.html
3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][SPARK-XXXX] Your PR title ...'.
4. Be sure to keep the PR description updated to reflect all changes.
5. Please write your PR title to summarize what this PR proposes.
6. If possible, provide a concise example to reproduce the issue for a faster review.
7. If you want to add a new configuration, please read the guideline first for naming configurations in
'core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala'.
-->
### What changes were proposed in this pull request?
remove python 3.8 from python/run-tests.py and stop build breaks
### Why are the changes needed?
the python tests are running against the bare-bones system install of python3, rather than an anaconda environment.
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
jenkins
see also https://github.com/apache/spark/pull/30506
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733984340
**[Test build #131814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131814/testReport)** for PR 30509 at commit [`7695f29`](https://github.com/apache/spark/commit/7695f291d2edd2b1ca71861ef8032eb087c61e8a).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733986625
BTW, @shaneknapp .
We can have `python3.8` at `Ubuntu 20.04` with package `python3.8`. What about installing Python3.8?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733987471
> BTW, @shaneknapp .
> We can have `python3.8` at `Ubuntu 20.04` with package `python3.8`. What about installing Python3.8?
right now, i have to finish porting everything, including the master node, to ubuntu20. then in a ~month, reinstall all the old ubuntu 16 workers. during this time we'll also get through the backlog of outstanding package reqs, as well as setting up a py38 environment.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
shaneknapp commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733997626
hmm, well this didn't get autoclosed for some reason. closing manually. it's merged in to 3.0...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
SparkQA removed a comment on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733984340
**[Test build #131814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131814/testReport)** for PR 30509 at commit [`7695f29`](https://github.com/apache/spark/commit/7695f291d2edd2b1ca71861ef8032eb087c61e8a).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
dongjoon-hyun commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733987709
Got it. No problem~
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] shaneknapp closed pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
shaneknapp closed pull request #30509:
URL: https://github.com/apache/spark/pull/30509
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
SparkQA commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733996146
**[Test build #131814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131814/testReport)** for PR 30509 at commit [`7695f29`](https://github.com/apache/spark/commit/7695f291d2edd2b1ca71861ef8032eb087c61e8a).
* This patch passes all tests.
* This patch merges cleanly.
* This patch adds no public classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-734019905
LGTM. Thanks for fixing this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #30509: [SPARK-33565][PYTHON][BUILD][3.0] Remove py38 spark3
Posted by GitBox <gi...@apache.org>.
AmplabJenkins commented on pull request #30509:
URL: https://github.com/apache/spark/pull/30509#issuecomment-733999511
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org