You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/10/22 21:06:58 UTC
[PR] chore(ci): build the bundle validation base image on glibc [hudi]
yihua opened a new pull request, #20417:
URL: https://github.com/apache/hudi/pull/20417
### Describe the issue this Pull Request addresses
closes #20416
### Summary and Changelog
Builds the bundle validation base image on Ubuntu (Temurin 8 as the default runtime, Ubuntu's OpenJDK 11 and 17 symlinked to the `/usr/lib/jvm/java-11-openjdk` and `java-17-openjdk` paths `validate.sh` switches to) instead of Alpine, so bundles that carry native libraries, such as the Spark native bundle with `libcomet.so`, run in it. The `base-dev` variant follows. Two shell fixes ride along: the Scala 2.13 Spark download condition becomes a bash `[[ ]]` test (the `[ a && b ]` form was always false, so Scala 2.13 images got the Scala 2.12 Spark build), and the per-run Dockerfile's `wget -t=3` becomes `wget -t 3`, which GNU wget accepts. The per-run Dockerfile's `apk add libstdc++` for RocksDB now runs only when `apk` exists, so it builds on both the old Alpine tags and the new glibc ones. The README explains that rebuilding an existing tag with its script and pushing it under the same name moves that lane to glibc with no workflow change, once this Dockerfile is on every branch t
hat validates against that tag.
### Impact
None until a tag is rebuilt and pushed: CI pulls the published images by tag, and this PR publishes nothing. Each rebuilt tag swaps the image under the lanes that use it.
### Risk Level
low
Verified locally: the JDK and tooling layer builds, `java -version` reports 8, 11 and 17 at the expected paths on glibc, bash is the build shell so the per-run Dockerfile's `[[ ]]` lines keep working, and GNU `wget -t 3` resolves Maven Central. The full `flink1200hive313spark351` image build and a `validate.sh` run in it are pending a machine with disk room; the first rebuilt tag should be proven in CI before the others are rebuilt.
### Documentation Update
`packaging/bundle-validation/README.md`: the image is glibc, and how to move an existing tag.
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): build the bundle validation base image on glibc [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #20417:
URL: https://github.com/apache/hudi/pull/20417#issuecomment-6353886201
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/20417?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 56.76%. Comparing base ([`5cce63e`](https://app.codecov.io/gh/apache/hudi/commit/5cce63e83c482e8c0dcd686919d00a1527b5ec9e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`6670dfe`](https://app.codecov.io/gh/apache/hudi/commit/6670dfef2d99d7575b8ccb69319e3391a1f69ac7?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 3 commits behind head on master.
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #20417 +/- ##
=========================================
Coverage 56.75% 56.76%
- Complexity 26066 26067 +1
=========================================
Files 2573 2573
Lines 146420 146420
Branches 17929 17929
=========================================
+ Hits 83107 83111 +4
+ Misses 57397 57395 -2
+ Partials 5916 5914 -2
```
| [Components](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hudi-common](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `79.27% <ø> (+<0.01%)` | :arrow_up: |
| [hudi-client](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `64.38% <ø> (+<0.01%)` | :arrow_up: |
| [hudi-flink](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `86.12% <ø> (ø)` | |
| [hudi-spark-datasource](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `15.24% <ø> (ø)` | |
| [hudi-utilities](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `1.13% <ø> (ø)` | |
| [hudi-cli](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `17.20% <ø> (ø)` | |
| [hudi-hadoop](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `67.15% <ø> (ø)` | |
| [hudi-sync](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `76.35% <ø> (ø)` | |
| [hudi-io](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `80.41% <ø> (ø)` | |
| [hudi-timeline-service](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `78.13% <ø> (ø)` | |
| [hudi-cloud](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `81.01% <ø> (ø)` | |
| [hudi-kafka-connect](https://app.codecov.io/gh/apache/hudi/pull/20417/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `0.00% <ø> (ø)` | |
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/20417/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/20417/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.98% <ø> (+0.08%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 2 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/20417/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): build the bundle validation base image on glibc [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #20417:
URL: https://github.com/apache/hudi/pull/20417
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org