You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2023/10/10 11:55:20 UTC
[spark] branch master updated: [SPARK-45479][INFRA] Uses the default Python versions in the scheduled builds in other branches
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 397bbb68cc4 [SPARK-45479][INFRA] Uses the default Python versions in the scheduled builds in other branches
397bbb68cc4 is described below
commit 397bbb68cc4aba6a99e89f145231eff6ad272253
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Tue Oct 10 20:55:04 2023 +0900
[SPARK-45479][INFRA] Uses the default Python versions in the scheduled builds in other branches
### What changes were proposed in this pull request?
This PR explicitly sets `PYTHON_TO_TEST` to an empty string for other branches so they use their default Python versions.
https://github.com/apache/spark/pull/43209 added a new option to the testing script but that option does not exist in other branches so it fails.
### Why are the changes needed?
To recover the build (see https://github.com/apache/spark/actions/workflows/build_branch33.yml, https://github.com/apache/spark/actions/workflows/build_branch34.yml and https://github.com/apache/spark/actions/workflows/build_branch35.yml)
### Does this PR introduce _any_ user-facing change?
No, dev-only.
### How was this patch tested?
After merging this, I will monitor the build. I locally tested the changes too.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #43306 from HyukjinKwon/SPARK-45479.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
.github/workflows/build_and_test.yml | 7 ++++++-
.github/workflows/build_branch33.yml | 3 ++-
.github/workflows/build_branch34.yml | 3 ++-
.github/workflows/build_branch35.yml | 3 ++-
4 files changed, 12 insertions(+), 4 deletions(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 4cdbdc31fb9..b9bce98b4d2 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -448,7 +448,12 @@ jobs:
export SKIP_PACKAGING=false
echo "Python Packaging Tests Enabled!"
fi
- ./dev/run-tests --parallelism 1 --modules "$MODULES_TO_TEST" --python-executables "$PYTHON_TO_TEST"
+ if [ ! -z "$PYTHON_TO_TEST" ]; then
+ ./dev/run-tests --parallelism 1 --modules "$MODULES_TO_TEST" --python-executables "$PYTHON_TO_TEST"
+ else
+ # For branch-3.5 and below, it uses the default Python versions.
+ ./dev/run-tests --parallelism 1 --modules "$MODULES_TO_TEST"
+ fi
- name: Upload coverage to Codecov
if: fromJSON(inputs.envs).PYSPARK_CODECOV == 'true'
uses: codecov/codecov-action@v2
diff --git a/.github/workflows/build_branch33.yml b/.github/workflows/build_branch33.yml
index 7ceafceb718..63a950447f5 100644
--- a/.github/workflows/build_branch33.yml
+++ b/.github/workflows/build_branch33.yml
@@ -36,7 +36,8 @@ jobs:
hadoop: hadoop3
envs: >-
{
- "SCALA_PROFILE": "scala2.13"
+ "SCALA_PROFILE": "scala2.13",
+ "PYTHON_TO_TEST": ""
}
jobs: >-
{
diff --git a/.github/workflows/build_branch34.yml b/.github/workflows/build_branch34.yml
index e7d66ad9912..740b68b69e3 100644
--- a/.github/workflows/build_branch34.yml
+++ b/.github/workflows/build_branch34.yml
@@ -36,7 +36,8 @@ jobs:
hadoop: hadoop3
envs: >-
{
- "SCALA_PROFILE": "scala2.13"
+ "SCALA_PROFILE": "scala2.13",
+ "PYTHON_TO_TEST": ""
}
jobs: >-
{
diff --git a/.github/workflows/build_branch35.yml b/.github/workflows/build_branch35.yml
index 1d2f2d8744c..15ee66a9ce4 100644
--- a/.github/workflows/build_branch35.yml
+++ b/.github/workflows/build_branch35.yml
@@ -36,7 +36,8 @@ jobs:
hadoop: hadoop3
envs: >-
{
- "SCALA_PROFILE": "scala2.13"
+ "SCALA_PROFILE": "scala2.13",
+ "PYTHON_TO_TEST": ""
}
jobs: >-
{
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org