You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "aglinxinyuan (via GitHub)" <gi...@apache.org> on 2026/08/17 05:32:12 UTC
[PR] ci: stop Renovate from bumping the CI Python version [texera]
aglinxinyuan opened a new pull request, #7721:
URL: https://github.com/apache/texera/pull/7721
### What changes were proposed in this PR?
`renovate.json5` already freezes `numpy` / `pandas` / `pyarrow` as Arrow IPC data-path pins, but not the **interpreter** their wheels are selected for. Renovate raised `actions/setup-python`'s `python-version:` to 3.14 in #7715, and `build / amber-integration` failed on both runners at *Install Python dependencies*:
```
Before: Renovate bumps python-version -> 3.14 -> no numpy cp314 wheel
-> uv source-builds numpy -> 11 compile errors -> job fails
After: python-version frozen with the numpy/pandas pins
-> prebuilt wheel resolves -> job installs as before
```
The interpreter is downstream of the pins the rule above deliberately holds back:
| Pin in `amber/requirements.txt` | Wheels published | cp314? |
| --- | --- | --- |
| `numpy==2.1.0` | cp310–cp313 | no |
| `pandas==2.2.3` | cp310–cp313 | no |
| `pyarrow==23.0.1` | cp310–cp314 | yes |
So this adds one `packageRules` entry disabling the `python` dep under the `github-actions` manager, directly below the pins it is coupled to, with a comment recording why. Both `python` and `actions/python-versions` are listed because Renovate names the dep `python` while resolving it from that releases repo.
Freezing rather than capping at `<3.14` was deliberate: matching is by name, so the rule can be verified offline, whereas an `allowedVersions` range is compared against `actions/python-versions` strings like `3.14.7-31064857500` and a wrong range fails silently in either direction.
Three sites stop moving on their own — `build.yml:401` (`amber-integration`, 3.11), `build.yml:127` (`frontend`, 3.12), `benchmarks.yml:217` (`Bench`, 3.12). The pyamber matrix at `build.yml:1041` is `["3.11", "3.12", "3.13"]`, a plain list Renovate never read, so it has to be widened in the same manual step as the pins — the comment says so.
Not addressed here: `build / frontend (macos-latest)` is also red on #7715, but that reproduces on clean `main` and is the Vitest CI stall already tracked by #7623 (details below).
### Any related issues, documentation, discussions?
Closes #7720
### How was this PR tested?
Validated with Renovate's own validator, in repo-config mode (auto-discovery, run from the repo root):
```bash
npx --yes --package renovate renovate-config-validator
```
```
INFO: Validating .github/renovate.json5
INFO: Config validated successfully against 1 file(s)
```
Negative control, to confirm the validator actually inspects `packageRules` rather than rubber-stamping the file — temporarily renaming the matcher and adding a junk key:
```
ERROR: Found errors in configuration
"errors": [
{ "message": "Invalid configuration option: packageRules[19].bogusOption" },
{ "message": "Invalid configuration option: packageRules[19].matchDepNamesTYPO" }
]
```
Wheel availability confirmed against PyPI, which is the fact the rule encodes:
```bash
curl -s https://pypi.org/pypi/numpy/2.1.0/json | grep -o 'cp3[0-9][0-9]' | sort -u # cp310 cp311 cp312 cp313
curl -s https://pypi.org/pypi/pandas/2.2.3/json | grep -o 'cp3[0-9][0-9]' | sort -u # cp310 cp311 cp312 cp313
```
Matching the failing CI log from #7715, which source-builds numpy for cp314 and stops on the 3.14 headers:
```
Building numpy==2.1.0
× Failed to build `numpy==2.1.0`
╰─▶ Call to `mesonpy.build_wheel` failed (exit status: 1)
../numpy/_core/src/umath/string_fastsearch.h:132:5: error: no type named
'ptrdiff_t' in namespace 'std'
11 errors generated.
numpy/_core/_multiarray_umath.cpython-314-darwin.so.p/...
```
Separately, `build / frontend (macos-latest)` was checked and ruled out as unrelated: it fails the same way on a **push to `main`** at `7a2c8d03b5`, which carries none of #7715's changes — same step, same `Test timed out in 5000ms`, ~332s run, a different randomly-hit spec each time. That is #7623, not this.
The rule itself only takes effect once Renovate next regenerates the `github-actions` branch, so #7715 needs a rebase after this merges to pick it up.
### Was this PR authored or co-authored using generative AI tooling?
Generated-by: Claude Code (claude-opus-5)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] ci: stop Renovate from bumping the CI Python version [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7721:
URL: https://github.com/apache/texera/pull/7721#issuecomment-5312241802
<!-- texera-reviewer-suggestion -->
### Automated Reviewer Suggestions
Based on the `git blame` history of the changed files, we recommend the following reviewers:
- **Contributors with relevant context:** `@Yicong-Huang`
You can notify them by mentioning `@Yicong-Huang` in a comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] ci: stop Renovate from bumping the CI Python version [texera]
Posted by "aglinxinyuan (via GitHub)" <gi...@apache.org>.
aglinxinyuan closed pull request #7721: ci: stop Renovate from bumping the CI Python version
URL: https://github.com/apache/texera/pull/7721
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] ci: stop Renovate from bumping the CI Python version [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7721:
URL: https://github.com/apache/texera/pull/7721#issuecomment-5312294038
<!-- texera-benchmarks-comment -->
## ⚠️ Benchmark changes need a look
🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline
> Compared against main `1011ff7` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
[Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31998396946)
| | config | throughput | MB/s | latency | max Δ latest / 7d |
|---|---|---:|---:|---:|---:|
| 🔴 | bs=10 sw=10 sl=64 | 373 | 0.228 | 25,442/33,809/33,809 us | 🔴 +10.2% / 🔴 +109.1% |
| 🔴 | bs=100 sw=10 sl=64 | 792 | 0.484 | 120,687/175,478/175,478 us | 🔴 +12.0% / 🔴 +66.1% |
| ⚪ | bs=1000 sw=10 sl=64 | 949 | 0.579 | 1,053,232/1,093,556/1,093,556 us | ⚪ within ±5% / 🔴 -10.2% |
<details><summary>Baseline details</summary>
Latest main `1011ff7` from same runner
| config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
|---|---|---:|---:|---:|---:|---:|
| bs=10 sw=10 sl=64 | throughput | 373 tuples/sec | 406 tuples/sec | 784.16 tuples/sec | -8.1% | -52.4% |
| bs=10 sw=10 sl=64 | MB/s | 0.228 MB/s | 0.248 MB/s | 0.479 MB/s | -8.1% | -52.4% |
| bs=10 sw=10 sl=64 | p50 | 25,442 us | 23,091 us | 12,626 us | +10.2% | +101.5% |
| bs=10 sw=10 sl=64 | p95 | 33,809 us | 35,776 us | 16,169 us | -5.5% | +109.1% |
| bs=10 sw=10 sl=64 | p99 | 33,809 us | 35,776 us | 18,986 us | -5.5% | +78.1% |
| bs=100 sw=10 sl=64 | throughput | 792 tuples/sec | 825 tuples/sec | 1,023 tuples/sec | -4.0% | -22.6% |
| bs=100 sw=10 sl=64 | MB/s | 0.484 MB/s | 0.504 MB/s | 0.625 MB/s | -4.0% | -22.5% |
| bs=100 sw=10 sl=64 | p50 | 120,687 us | 117,719 us | 99,185 us | +2.5% | +21.7% |
| bs=100 sw=10 sl=64 | p95 | 175,478 us | 156,683 us | 105,616 us | +12.0% | +66.1% |
| bs=100 sw=10 sl=64 | p99 | 175,478 us | 156,683 us | 113,681 us | +12.0% | +54.4% |
| bs=1000 sw=10 sl=64 | throughput | 949 tuples/sec | 949 tuples/sec | 1,057 tuples/sec | 0.0% | -10.2% |
| bs=1000 sw=10 sl=64 | MB/s | 0.579 MB/s | 0.579 MB/s | 0.645 MB/s | 0.0% | -10.2% |
| bs=1000 sw=10 sl=64 | p50 | 1,053,232 us | 1,055,109 us | 965,435 us | -0.2% | +9.1% |
| bs=1000 sw=10 sl=64 | p95 | 1,093,556 us | 1,103,290 us | 1,012,135 us | -0.9% | +8.0% |
| bs=1000 sw=10 sl=64 | p99 | 1,093,556 us | 1,103,290 us | 1,042,088 us | -0.9% | +4.9% |
</details>
<details><summary>Raw CSV</summary>
```csv
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
0,10,10,64,20,535.74,200,128000,373,0.228,25441.68,33809.13,33809.13
1,100,10,64,20,2524.10,2000,1280000,792,0.484,120687.06,175478.49,175478.49
2,1000,10,64,20,21065.68,20000,12800000,949,0.579,1053231.64,1093556.19,1093556.19
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] ci: stop Renovate from bumping the CI Python version [texera]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #7721:
URL: https://github.com/apache/texera/pull/7721#issuecomment-5312263715
## [Codecov](https://app.codecov.io/gh/apache/texera/pull/7721?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 90.93%. Comparing base ([`1011ff7`](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`c614855`](https://app.codecov.io/gh/apache/texera/commit/c6148551aba3c043dd8286b9d376c4b2d7527b96?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #7721 +/- ##
=========================================
Coverage 90.93% 90.93%
Complexity 4452 4452
=========================================
Files 1175 1175
Lines 47140 47140
Branches 5284 5284
=========================================
Hits 42869 42869
Misses 2581 2581
Partials 1690 1690
```
| [Flag](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | *Carryforward flag |
|---|---|---|---|
| [access-control-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `81.00% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [agent-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `98.62% <ø> (ø)` | | |
| [amber](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `87.39% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [computing-unit-managing-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `73.67% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [config-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `86.73% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [file-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `68.90% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [frontend](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `92.44% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [notebook-migration-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.74% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [pyamber](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `97.57% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [workflow-compiling-service](https://app.codecov.io/gh/apache/texera/pull/7721/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `77.19% <ø> (ø)` | | Carriedforward from [1011ff7](https://app.codecov.io/gh/apache/texera/commit/1011ff7d501ad05a7e30605893eea8cc99e29bf5?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
*This pull request uses carry forward flags. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) to find out more.
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/texera/pull/7721?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org