You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2021/03/31 11:21:39 UTC
[spark] branch branch-3.1 updated: [SPARK-34915][INFRA] Cache Maven,
SBT and Scala in all jobs that use them
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.1 by this push:
new b3a27fb [SPARK-34915][INFRA] Cache Maven, SBT and Scala in all jobs that use them
b3a27fb is described below
commit b3a27fbb73ae48f9a9ba976b810dabd1e01b2e3a
Author: HyukjinKwon <gu...@apache.org>
AuthorDate: Wed Mar 31 18:13:50 2021 +0800
[SPARK-34915][INFRA] Cache Maven, SBT and Scala in all jobs that use them
This PR proposes to cache Maven, SBT and Scala in all jobs that use them. For simplicity, we use the same key `build-` and just cache all SBT, Maven and Scala. The cache is not very large.
To speed up the build.
No, dev-only.
It will be tested in this PR's GA jobs.
Closes #32011 from HyukjinKwon/SPARK-34915.
Authored-by: HyukjinKwon <gu...@apache.org>
Signed-off-by: Gengliang Wang <lt...@gmail.com>
(cherry picked from commit 48ef9bd2b3a0cb52aaa31a3fada8779b7a7b9132)
Signed-off-by: HyukjinKwon <gu...@apache.org>
---
.github/workflows/build_and_test.yml | 22 ++++++++++++++++++++++
1 file changed, 22 insertions(+)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index eb5f43b..0d36abe 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -369,6 +369,17 @@ jobs:
steps:
- name: Checkout Spark repository
uses: actions/checkout@v2
+ - name: Cache Scala, SBT and Maven
+ uses: actions/cache@v2
+ with:
+ path: |
+ build/apache-maven-*
+ build/scala-*
+ build/*.jar
+ ~/.sbt
+ key: build-${{ hashFiles('**/pom.xml', 'project/build.properties', 'build/mvn', 'build/sbt', 'build/sbt-launch-lib.bash', 'build/spark-build-info') }}
+ restore-keys: |
+ build-
- name: Cache Maven local repository
uses: actions/cache@v2
with:
@@ -394,6 +405,17 @@ jobs:
steps:
- name: Checkout Spark repository
uses: actions/checkout@v2
+ - name: Cache Scala, SBT and Maven
+ uses: actions/cache@v2
+ with:
+ path: |
+ build/apache-maven-*
+ build/scala-*
+ build/*.jar
+ ~/.sbt
+ key: build-${{ hashFiles('**/pom.xml', 'project/build.properties', 'build/mvn', 'build/sbt', 'build/sbt-launch-lib.bash', 'build/spark-build-info') }}
+ restore-keys: |
+ build-
- name: Cache Coursier local repository
uses: actions/cache@v2
with:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org