You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/09/25 08:32:25 UTC

[PR] [GLUTEN-12412][VL] Migrate Delta CI native builder to AlmaLinux 8 [gluten]

felipepessoto opened a new pull request, #13132:
URL: https://github.com/apache/gluten/pull/13132

   <!--
   Thank you for submitting a pull request! Here are some tips:
   
   1. For first-time contributors, please read our contributing guide:
      https://github.com/apache/gluten/blob/main/CONTRIBUTING.md
   2. If necessary, create a GitHub issue for discussion beforehand to avoid duplicate work.
   3. If the PR is specific to a single backend, include [VL] or [CH] in the PR title to indicate the
      Velox or ClickHouse backend, respectively.
   4. If the PR is not ready for review, please mark it as a draft.
   -->
   
   ## What changes are proposed in this pull request?
   
   <!--
   Provide a clear and concise description of the changes introduced in this PR.
   Ensure the PR description aligns with the code changes, especially after updates.
   If applicable, include "Fixes #<GitHub_Issue_ID>" to automatically close the corresponding issue
   when the PR is merged.
   -->
   
   Standalone follow-up to #12663, related to #12412. The main native workflows already use AlmaLinux 8, but the separately owned Delta Spark UT workflow still uses CentOS 7.
   
   - Use `apache/gluten:vcpkg-almalinux-8-gcc13`, `dnf install -y bison tzdata`, and the existing `dev/ci-velox-buildstatic-centos-8.sh` build path. GCC remains at version 13.
   - Rename the native job and its downstream dependency/artifacts from `centos-7` to `centos-8`, and align restore/save cache keys with `ccache-almalinux8-release-default`.
   - Upload dependency/native build diagnostics on failure with seven-day retention, including hidden `.vcpkg` build logs, the vcpkg issue body, and CMake logs.
   - Update the related workflow comments and Delta CI README.
   
   Only `.github/workflows/delta_spark_ut.yml` and `.github/workflows/util/delta-spark-ut/README.md` change. The downstream CentOS 9 bundle/test environments, all eight test shards, triggers, regression/fail-on-fixed gates, and baselines are unchanged. No Delta DV implementation or baseline changes are included; this is based directly on `main`, not stacked on the DV feature.
   
   ## How was this patch tested?
   
   <!--
   Describe how the changes were tested, if applicable.
   Include new tests to validate the functionality, if necessary.
   For UI-related changes, attach screenshots to demonstrate the updates.
   -->
   
   - Parsed the workflow with PyYAML 6.0.1, rejecting duplicate mapping keys. Compared the complete YAML structure against current `main`, allowing only the native migration and failure-diagnostics step; confirmed all test/shard and aggregate jobs, triggers, permissions, concurrency, and gate inputs are unchanged.
   - Verified job dependencies, matching native artifact upload/download names, restore/save cache consistency with the main x86 workflow, and all requested diagnostic paths with hidden-file inclusion and seven-day retention.
   - Passed `git diff --check` and the repository CI license checker (`.github/workflows/util/license-header.py -k` on the changed YAML).
   
   **Prior combined-branch evidence, not standalone-head CI:** the legacy CentOS 7 [native build](https://github.com/apache/gluten/actions/runs/36057829606/job/107829444083) failed in `mvfst:x64-linux-avx` version `2026.09.07.00` before Gluten compilation. With this native-builder migration, [run 36061115435](https://github.com/apache/gluten/actions/runs/36061115435) passed both the [native build](https://github.com/apache/gluten/actions/runs/36061115435/job/107840033501) and [bundle build](https://github.com/apache/gluten/actions/runs/36061115435/job/107873933024). All eight Delta shards completed with zero new regressions: six gates passed, while two flagged ten now-passing baseline tests from the unrelated DV feature. Those baseline entries are untouched here.
   
   This draft still needs its own standalone-head CI. No local JVM/native rebuild was needed for this workflow/documentation-only change.
   
   ## Was this patch authored or co-authored using generative AI tooling?
   
   <!--
   If generative AI tooling has been used in the process of authoring this patch, please include the
   phrase: 'Generated-by: ' followed by the name of the tool and its version.
   If no, write 'No'.
   Please refer to the [ASF Generative Tooling Guidance](https://www.apache.org/legal/generative-tooling.html) for details.
   -->
   
   Generated-by: GitHub Copilot CLI 1.0.87-0 (GPT-6 Astra, model ID: gpt-6-astra)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-12412][VL] Migrate Delta CI native builder to AlmaLinux 8 [gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on PR #13132:
URL: https://github.com/apache/gluten/pull/13132#issuecomment-5829474292

   @felipepessoto thanks, I will cherry pick this into today's rebase patch


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-12412][VL] Migrate Delta CI native builder to AlmaLinux 8 [gluten]

Posted by "felipepessoto (via GitHub)" <gi...@apache.org>.
felipepessoto closed pull request #13132: [GLUTEN-12412][VL] Migrate Delta CI native builder to AlmaLinux 8
URL: https://github.com/apache/gluten/pull/13132


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-12412][VL] Migrate Delta CI native builder to AlmaLinux 8 [gluten]

Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on PR #13132:
URL: https://github.com/apache/gluten/pull/13132#issuecomment-5832995404

   include in https://github.com/apache/gluten/pull/13127


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org