You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2025/01/16 19:33:52 UTC

(spark) branch master updated: [SPARK-50852][INFRA] Add Java 21 Daily GitHub Action job for `branch-4.0`

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 11d758f48141 [SPARK-50852][INFRA] Add Java 21 Daily GitHub Action job for `branch-4.0`
11d758f48141 is described below

commit 11d758f481419fc4490de04103d14a7ad8758e47
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu Jan 16 11:33:38 2025 -0800

    [SPARK-50852][INFRA] Add Java 21 Daily GitHub Action job for `branch-4.0`
    
    ### What changes were proposed in this pull request?
    
    This PR aims to add `Java 21` Daily GitHub Action job for `branch-4.0`.
    
    ### Why are the changes needed?
    
    Like `build_java21.yml` on `master`, this PR provides Java 21 test coverage for `branch-4.0`.
    - https://github.com/apache/spark/actions/workflows/build_java21.yml
    
    Please note that this is added to `master` branch due to the GitHub Action cron feature requirements.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No, this is an addition to test infra.
    
    ### How was this patch tested?
    
    Manual review.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #49530 from dongjoon-hyun/SPARK-50852.
    
    Authored-by: Dongjoon Hyun <do...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 .github/workflows/build_branch40_java21.yml | 57 +++++++++++++++++++++++++++++
 1 file changed, 57 insertions(+)

diff --git a/.github/workflows/build_branch40_java21.yml b/.github/workflows/build_branch40_java21.yml
new file mode 100644
index 000000000000..3545c5fdb5f8
--- /dev/null
+++ b/.github/workflows/build_branch40_java21.yml
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+name: "Build (branch-4.0, Scala 2.13, Hadoop 3, JDK 21)"
+
+on:
+  schedule:
+    - cron: '0 5 * * *'
+  workflow_dispatch:
+
+jobs:
+  run-build:
+    permissions:
+      packages: write
+    name: Run
+    uses: ./.github/workflows/build_and_test.yml
+    if: github.repository == 'apache/spark'
+    with:
+      java: 21
+      branch: branch-4.0
+      hadoop: hadoop3
+      envs: >-
+        {
+          "PYSPARK_IMAGE_TO_TEST": "python-311",
+          "PYTHON_TO_TEST": "python3.11",
+          "SKIP_MIMA": "true",
+          "SKIP_UNIDOC": "true",
+          "DEDICATED_JVM_SBT_TESTS": "org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV1Suite,org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV2Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV1Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV2Suite"
+        }
+      jobs: >-
+        {
+          "build": "true",
+          "pyspark": "true",
+          "sparkr": "true",
+          "tpcds-1g": "true",
+          "docker-integration-tests": "true",
+          "yarn": "true",
+          "k8s-integration-tests": "true",
+          "buf": "true",
+          "ui": "true"
+        }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org