You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2023/05/29 00:15:30 UTC
[spark] branch master updated: [SPARK-43840][INFRA] Switch `scala-213` GitHub Action Job to `scala-212`
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new b93bd5e7dfe [SPARK-43840][INFRA] Switch `scala-213` GitHub Action Job to `scala-212`
b93bd5e7dfe is described below
commit b93bd5e7dfeaf184032ae123df1176c99868f759
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sun May 28 17:15:18 2023 -0700
[SPARK-43840][INFRA] Switch `scala-213` GitHub Action Job to `scala-212`
### What changes were proposed in this pull request?
This PR aims to switch `scala-213` GitHub Action Job to `scala-212`.
### Why are the changes needed?
Since SPARK-43836, Scala 2.13 is used by default. So, we need to test `Scala 2.12` instead of `Scala 2.13` in this additional test pipeline.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs and check the `scala-212` pipeline instead of `scala-213` pipeline.
https://github.com/dongjoon-hyun/spark/actions/runs/5105828839/jobs/9177657650
Closes #41351 from dongjoon-hyun/SPARK-43840.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 18 +++++++++---------
1 file changed, 9 insertions(+), 9 deletions(-)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 75d37971d96..cda5940f2bc 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -86,7 +86,7 @@ jobs:
sparkr=`./dev/is-changed.py -m sparkr`
tpcds=`./dev/is-changed.py -m sql`
docker=`./dev/is-changed.py -m docker-integration-tests`
- # 'build', 'scala-213', and 'java-11-17' are always true for now.
+ # 'build', 'scala-212', and 'java-11-17' are always true for now.
# It does not save significant time and most of PRs trigger the build.
precondition="
{
@@ -95,7 +95,7 @@ jobs:
\"sparkr\": \"$sparkr\",
\"tpcds-1g\": \"$tpcds\",
\"docker-integration-tests\": \"$docker\",
- \"scala-213\": \"true\",
+ \"scala-212\": \"true\",
\"java-11-17\": \"true\",
\"lint\" : \"true\",
\"k8s-integration-tests\" : \"true\",
@@ -728,10 +728,10 @@ jobs:
./build/mvn $MAVEN_CLI_OPTS -DskipTests -Pyarn -Pmesos -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Phadoop-cloud -Djava.version=${JAVA_VERSION/-ea} install
rm -rf ~/.m2/repository/org/apache/spark
- scala-213:
+ scala-212:
needs: precondition
- if: fromJson(needs.precondition.outputs.required).scala-213 == 'true'
- name: Scala 2.13 build with SBT
+ if: fromJson(needs.precondition.outputs.required).scala-212 == 'true'
+ name: Scala 2.12 build with SBT
runs-on: ubuntu-22.04
steps:
- name: Checkout Spark repository
@@ -761,9 +761,9 @@ jobs:
uses: actions/cache@v3
with:
path: ~/.cache/coursier
- key: scala-213-coursier-${{ hashFiles('**/pom.xml', '**/plugins.sbt') }}
+ key: scala-212-coursier-${{ hashFiles('**/pom.xml', '**/plugins.sbt') }}
restore-keys: |
- scala-213-coursier-
+ scala-212-coursier-
- name: Install Java 8
uses: actions/setup-java@v3
with:
@@ -771,8 +771,8 @@ jobs:
java-version: 8
- name: Build with SBT
run: |
- ./dev/change-scala-version.sh 2.13
- ./build/sbt -Pyarn -Pmesos -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Phadoop-cloud -Pkinesis-asl -Pdocker-integration-tests -Pkubernetes-integration-tests -Pspark-ganglia-lgpl -Pscala-2.13 compile Test/compile
+ ./dev/change-scala-version.sh 2.12
+ ./build/sbt -Pyarn -Pmesos -Pkubernetes -Pvolcano -Phive -Phive-thriftserver -Phadoop-cloud -Pkinesis-asl -Pdocker-integration-tests -Pkubernetes-integration-tests -Pspark-ganglia-lgpl -Pscala-2.12 compile Test/compile
# Any TPC-DS related updates on this job need to be applied to tpcds-1g-gen job of benchmark.yml as well
tpcds-1g:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org