You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2024/02/16 01:26:50 UTC

(spark) branch master updated: [SPARK-47067][INFRA] Add Daily Apple Silicon Github Action Job (Java/Scala)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 964545aa88e9 [SPARK-47067][INFRA] Add Daily Apple Silicon Github Action Job (Java/Scala)
964545aa88e9 is described below

commit 964545aa88e9fd5b033871cbeae8d40f1a4ced91
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Thu Feb 15 17:26:40 2024 -0800

    [SPARK-47067][INFRA] Add Daily Apple Silicon Github Action Job (Java/Scala)
    
    ### What changes were proposed in this pull request?
    
    This PR aims to add a new `Daily Apple Silicon Github Action (Java/Scala)` job for Apache Spark 4.0.0.
    
    ### Why are the changes needed?
    
    To have a test coverage for Apple Silicon environment in Java/Scala first.
    
    For Python and R, we need more efforts due to their library dependencies.
    
    We will add them separately.
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    Unfortunately, this should be tested after merging.
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No.
    
    Closes #45128 from dongjoon-hyun/SPARK-47067.
    
    Authored-by: Dongjoon Hyun <dh...@apple.com>
    Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
 .github/workflows/build_apple_silicon.yml | 47 +++++++++++++++++++++++++++++++
 1 file changed, 47 insertions(+)

diff --git a/.github/workflows/build_apple_silicon.yml b/.github/workflows/build_apple_silicon.yml
new file mode 100644
index 000000000000..52a906af3f04
--- /dev/null
+++ b/.github/workflows/build_apple_silicon.yml
@@ -0,0 +1,47 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#   http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied.  See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+
+name: "Build / Apple Silicon (master, JDK 21)"
+
+on:
+  schedule:
+    - cron: '0 20 * * *'
+
+jobs:
+  run-build:
+    permissions:
+      packages: write
+    name: Run
+    uses: ./.github/workflows/build_and_test.yml
+    runs-on: macos-14
+    if: github.repository == 'apache/spark'
+    with:
+      java: 21
+      branch: master
+      hadoop: hadoop3
+      envs: >-
+        {
+          "SKIP_MIMA": "true",
+          "SKIP_UNIDOC": "true",
+          "DEDICATED_JVM_SBT_TESTS": "org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV1Suite,org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV2Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV1Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV2Suite"
+        }
+      jobs: >-
+        {
+          "build": "true"
+        }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org