You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@celeborn.apache.org by ni...@apache.org on 2024/02/29 13:48:58 UTC
(incubator-celeborn) branch main updated: [CELEBORN-1298][FOLLOWUP] Support Spark2.4 with Scala2.12
This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 93d2b9f47 [CELEBORN-1298][FOLLOWUP] Support Spark2.4 with Scala2.12
93d2b9f47 is described below
commit 93d2b9f47fb69ec2ba3694df5d30a8c91c754469
Author: SteNicholas <pr...@163.com>
AuthorDate: Thu Feb 29 21:48:51 2024 +0800
[CELEBORN-1298][FOLLOWUP] Support Spark2.4 with Scala2.12
### What changes were proposed in this pull request?
Support Spark2.4 with Scala2.12 in `sbt.md`. Meanwhile, the CI workflow adds the test for Spark2.4 and Scala2.12.
Follow up #2344.
### Why are the changes needed?
Spark2.4 with Scala2.12 is supported.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI.
Closes #2345 from SteNicholas/CELEBORN-1298.
Authored-by: SteNicholas <pr...@163.com>
Signed-off-by: SteNicholas <pr...@163.com>
---
.github/workflows/sbt.yml | 3 +++
docs/developers/sbt.md | 2 +-
2 files changed, 4 insertions(+), 1 deletion(-)
diff --git a/.github/workflows/sbt.yml b/.github/workflows/sbt.yml
index d5411fd65..53e5db67a 100644
--- a/.github/workflows/sbt.yml
+++ b/.github/workflows/sbt.yml
@@ -69,6 +69,9 @@ jobs:
- 8
spark:
- '2.4'
+ scala-binary:
+ - '2.11'
+ - '2.12'
steps:
- uses: actions/checkout@v2
- name: Setup JDK ${{ matrix.java }}
diff --git a/docs/developers/sbt.md b/docs/developers/sbt.md
index 5f198931d..de278f3e2 100644
--- a/docs/developers/sbt.md
+++ b/docs/developers/sbt.md
@@ -28,7 +28,7 @@ The following table indicates the compatibility of Celeborn Spark and Flink clie
| | Java 8/Scala 2.11 | Java 8/Scala 2.12 | Java 11/Scala 2.12 | Java 17/Scala 2.12 | Java 8/Scala 2.13 | Java 11/Scala 2.13 | Java 17/Scala 2.13 |
|------------|-------------------|-------------------|--------------------|--------------------|-------------------|--------------------|--------------------|
-| Spark 2.4 | ✔ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ |
+| Spark 2.4 | ✔ | ✔ | ❌ | ❌ | ❌ | ❌ | ❌ |
| Spark 3.0 | ❌ | ✔ | ✔ | ❌ | ❌ | ❌ | ❌ |
| Spark 3.1 | ❌ | ✔ | ✔ | ❌ | ❌ | ❌ | ❌ |
| Spark 3.2 | ❌ | ✔ | ✔ | ❌ | ✔ | ✔ | ❌ |